DATA SEARCH
& PROCESSING

TRIGGERED
PROCESSING

DEVELOPMENT
& TESTING

COLLABORATION &
DOCUMENTATION

Register

Sign In

Service offering

Exception occured

Polar TEP Service Offering

The portfolio of Polar TEP services is listed in the table below.

If you are a research, development or pre-commercial user, you can benefit from ESA’s Network of Resources sponsorship https://eo4society.esa.int/sponsorship/

1. Machine Learning Environment

The Polar TEP machine learning platform provides a full stack of services needed to manage the entire lifecycle of data - from storage with the world's most scalable Hadoop distribution and its unique metadata architecture HopsFS, to integration of popular distributed processing frameworks such as Apache Spark and Apache Flink, to rich APIs and integration of popular machine learning libraries such as TensorFlow and PyTorch for developing machine learning applications and pipelines. Furthermore, the platform provides a multi-tenant security model based on the abstractions of projects and datasets.

Once a processor has been trained in the machine learning environment, it can be ported to Polar TEP's processor execution environment for routine operational processing.

PTEP-ML

Polar TEP Machine Learning Environment

€1,500/Month

2. Processor Development Environment

Polar TEP provides two paths to support processor development:

A customized VM with all necessary software tools and libraries for development. Various configurations and languages are available upon request.
An Interactive Development Environment (IDE) based on Jupyter Notebooks.

PTEP-DE Small	Polar TEP Development Environment Small	€550/Month
	2 CPUs 8 GB RAM 32 GB SSD Python Language
PTEP-DE Medium	Polar TEP Development Environment Medium	€650/Month
	4 CPUs 32 GB RAM 128 GB SSD Python Language
PTEP-DE Large	Polar TEP Development Environment Large	€750/Month
	8 CPUs 64 GB RAM 256 GB SSD Python Language
PTEP-DE Int	Polar TEP Development Environment Interactive	€550/Month
	Jupyter Notebooks

3. Processor Execution Environment

Polar TEP provides built-in processors, or users can develop their own (in the Polar TEP Development Environment or in the user's own environment) and implement them in the Polar TEP Processor Execution Environment through the use of Docker containers. A JSON definition file specifies user inputs and defaults for the processor that will be displayed in the processor's user interface. Processors can be used privately or shared with other users.

In the execution environment, processors have access to computation resources that scale dynamically with demand. Processors can be invoked manually through the user interface, or automatically for batch processing (processing of large data collections) or triggered processing (processing invoked as new data is received).

Two levels of access to the Processor Execution Environment are available and the first three months are free.

PTEP-EE Trial	Polar TEP Execution Environment 3 Month Trial	Free for 3 months
	Up to 500 CPU hours of processing time per month.
PTEP-EE Standard	Polar TEP Execution Environment Standard	€500/Month
	Up to 500 CPU hours of processing time per month.
PTEP-EE Large	Polar TEP Execution Environment Large	€1000/Month
	Up to 1000 CPU hours of processing time per month.

4. Application Hosting Environment

For users who want to host their own applications on a VM within the Polar TEP environment, three sizes are available. Other configurations are available upon request. Ports can be opened for external communications.

PTEP-HE Small	Polar TEP Hosting Environment Small	€550/Month
	2 CPUs 8 GB RAM 32 GB SSD
PTEP-HE Medium	Polar TEP Hosting Environment Medium	€650/Month
	4 CPUs 32 GB RAM 128 GB SSD
PTEP-HE Large	Polar TEP Hosting Environment Large	€750/Month
	8 CPUs 64 GB RAM 256 GB SSD

5. Additional Data Storage

Polar TEP Processor Development and Application Hosting Environments come with data storage. If additional storage is required, three types are available.

PTEP-DS SSD	Polar TEP Hosting Environment Small	€100/TB/Month
	Solid State Storage
PTEP-DS HDD	Polar TEP Additional Data Storage HDD	€50/TB/Month
	Magnetic Storage
PTEP-DS OS	Polar TEP Additional Data Storage Object	€30/TB/Month
	Object Storage

6. Processor Integration Support Service

Integration of processors into the Polar TEP Execution Environment is documented and examples are provided. If addition support is required, two levels are available.

PTEP-IS Smal	Polar TEP Integration Support Service Small	€5,000
	Suitable for most processors (up to 5 days of effort)
PTEP-IS Large	Polar TEP Integration Support Service Large	€9,000
	Processor with complex processing chains and external data sources (up to 10 days of effort)

7. Polar Data Management Support Service

The Polar TEP team includes the world-class expertise on all aspects of the management and use of polar data. They can provide advice to groups struggling with concepts and issues such as:

The polar data ecosystem
Ethically Open, FAIR, and CARE data principles
Federated search
Data publication, DOIs, and metadata
Vocabularies and semantics
Data interoperability standards and formats
Data processing tools and techniques such as machine learning and data cubes

PTEP-DM

Polar TEP Data Management Support Service

€1,000/day

Polar TEP Terms & Conditions

Terms

Polar TEP GDPR Statement

Introduction

The Polar Thematic Exploitation Platform (Polar TEP) is provided by Polar View ApS. Polar TEP is subject to the European Union’s General Data Protection Regulation (GDPR).

Protection of personal data is very important to Polar View. Polar View implements appropriate measures to preserve the rights of data subjects, to ensure the processing of personal data is for specified and legitimate purposes as necessary for the purposes for which the personal data were collected or for which they are further processed, and to ensure the processing occurs in conditions that protect the confidentiality, integrity and safety of personal data.

This notice is intended to inform you, as a Data Subject, about:

the identity of the Data Controller and contact details for the Polar View Data Protection Officer (DPO);
the type of personal data which is collected and processed;
the modalities of collection of personal data;
the purpose of the collection and processing;
the recipients (if any) to whom the personal data of the data subject shall be disclosed;
the time-limits for storing the personal data;
the practical modalities of exercising the rights of the data subject under GDPR.

Who is the Data Controller?

Polar View decides which personal data are collected and further processed. Thus, the Data Controller is Polar View.

What are the contact details of the Polar View Data Protection Officer?

Your first point of contact concerning personal data matters is the Polar View Data Protection Officer (DPO), who may be contacted at DPO@polarview.org.

What kind of personal data about you are collected and further processed?

The personal data which may be collected and further processed for the purposes mentioned below are in particular:

Name
Phone number
E-mail
Organisation
Organisation geographical location
Information in connection with your use of Polar View websites and data platforms, such as information in server logs, including information on how the platform was used by you, your search queries, IP (internet protocol) address and data about your system activity, hardware settings, browser settings, date and time of your request.
Cookies
Other information that you provide, and which may directly or indirectly identify you.

How are your personal data collected or further processed?

Your personal data may be collected by various means, including via registration at the Polar TEP website and your website usage.

Why are your personal data collected and further processed?

Your personal data are collected and further processed so that Polar View can:

provide you access to, and enable the use of Polar TEP;
improve your user experience and customise this experience to your needs;
send you notifications in connection with the status of Polar TEP and your use of it;
keep you informed about the status of your account resources and bill you for those services that you invoke that have a cost;
communicate news regarding Polar TEP; and
conduct surveys and gather user feedback.

To whom might we disclose your personal data?

Polar View will not disclose nor sell your personal data to any third parties.

How long do we retain your personal data for?

Polar View may keep your personal data for as long as necessary for the fulfilment of the purposes mentioned above. Your Personal Data will be deleted thereafter.

How can you erase, rectify, complete or amend your personal data?

Polar View is committed to collecting and processing accurate personal data and to keeping it up to date.

You may request the erasure, rectification, completion or amendment of your personal data if, and to the extent that, it is inaccurate or incomplete, or if they are processed in violation of the principles of the GDPR.

If you choose to make a request for the erasure of personal data, you understand and agree that the data will not be retrievable at a later date, and that it will result in the deletion of your Polar TEP account.

The request should be submitted to the Polar View DPO by sending an email to: dpo@polarview.org

What could you do in case of a data protection incident?

In case of a data protection incident, you should contact the Polar View DPO by sending an email to: dpo@polarview.org

Polar TEP Terms and Conditions

The Polar Thematic Exploitation Platform (Polar TEP) is a site on which registered users can upload and download content and process information. Users are responsible for knowing their rights and responsibilities, and for ensuring the appropriateness of how they use the site.

As a user of Polar TEP, you agree to abide by these guidelines. Failure to do so may result in termination of access.

You may use Polar TEP only for purposes in line with the objectives of supporting polar research and operations in the polar regions.

You may not use Polar TEP in any way which is in breach of any applicable local, national, or international law.

You are to be the only individual to access your account and will not knowingly permit access by others without written approval. You shall not divulge or share login information, such as passwords. You are responsible for notifying the Polar TEP administrator in a timely manner if your account password is compromised.

You shall not attempt to access any data or programs contained on systems for which you do not have authorisation from the owner of the data or processor.

Polar TEP systems and resources are subject to monitoring and recording, and you will have no expectation of privacy in any use of the systems.

You are responsible for using the computing systems, resources and facilities in an efficient and effective manner.

You shall not engage in activities that compromise or weaken the security of Polar TEP systems.

You are required to report any security weaknesses in the systems or any IT security incidents, including misuse or violation of this agreement, to the Polar TEP administrator.

You are required to access Polar TEP only from remote systems that are safe from malicious programs and activity.

You shall not use Polar TEP in such a way as to violate intellectual property rights.

Significant content on Polar TEP is user generated and it is not possible to provide assurance to the accuracy, relevance or usefulness of information published by users.

You have the responsibility for assuring the appropriateness of any information you post. Fraudulent, harassing, obscene, or sexually explicit language or materials are inappropriate and will not be tolerated. The collaborative tools are not moderated, but if an issue is brought to our attention, we reserve the right to remove any content that you have posted which is deemed inappropriate and take actions against you. You have the ability and responsibility to notify the Polar TEP administrator of inappropriate content posted by others.

You shall not imply, suggest, or indicate incorrectly that Polar View is responsible for any content emanating from or stored at or on Polar TEP.

About Polar TEP

Polar View Earth Observation Limited (Polar View) is developing a Polar Thematic Exploitation Platform (Polar TEP) for the European Space Agency (ESA). Polar TEP will provide polar researchers with access to computing resources, earth observation (EO) and other data, and software tools in the cloud. This new approach will remove the need to transfer large EO data sets around the world, while increasing the analytical power available to researchers and operational service providers.

In the traditional workflow for the analysis of earth observation (EO) data, users download the data to their local site and then process it using their available software and computing resources. With the increasing volume of data available from missions such as Sentinel, and the resulting need for powerful computing resources for processing, the existing methods of working are inefficient and restrict the use of EO data.

ESA’s Thematic Exploitation Platform (TEP) concept aims to provide a working environment where users can access algorithms and data remotely, providing them with computing resources and tools that they might not otherwise have, and avoiding the need to download and store large volumes of data. This new way of working will encourage wider exploitation of EO data.

EO is especially import in the polar regions at a time when climate change is having a profound impact and excitement about new economic opportunities is driving increased attention and traffic, resulting in concerns about the state of the region’s delicate ecosystems. Developing tools to model, understand and monitor these changes is vitally important in order to better predict and mitigate the resulting global economic and environmental consequences.

Polar View Earth Observation Limited is developing a TEP for ESA that will be customized for polar research and operational needs. Polar View brings a team to this project that combines a unique mix of polar domain experts, scientists, operational service providers, ICT experts, and user representatives. Polar TEP will integrate data discovery and access for a rich set of polar themed EO and complimentary datasets, a scalable computing environment, a suite of analytical tools and the ability for users to supply their own models, plus tools to allow sharing of results and promote collaboration. These resources will be accessed through a web portal.

The platform architecture will be open, scalable and independent of any specific IT infrastructure. This approach will allow easy expansion of the platform’s capabilities, and encourage the development of a wider network of other thematic exploitation platforms.

The polar regions are vast and have a growing significance for the entire globe. They play an important role in regulating and driving the global climate, but are also the regions experiencing the fastest increases in temperature associated with global climate change. Monitoring and understanding these changes is vitally important for everyone, not only the indigenous populations, since these changes will have global effects.

In the coming decades and as global climate change progresses, the world’s polar regions will become significantly more important. As a source of natural resources and current low population density, the Arctic is of increasing interest to politicians and industry. Global interest is fueled by environmental concerns for the delicate ecosystems and by excitement over perceived abundance of oil and gas. Where the Antarctic Treaty currently protects the southern polar regions from some of this attention, nevertheless there are still real pressures to ensure the Antarctic environment remains protected from increasing development.

Observations from space provide unique information which is essential for the successful understanding and management of climate change. The polar regions are remote and hostile environments where efforts to collect required observations and data are limited by very real constraints such as the weather, lack of infrastructure and long periods of polar darkness during the winters. As a consequence satellite platforms provide the only source of consistent, repeatable, regional scale, calibrated, year-round data of the polar regions. The large number of EO satellites observing various aspects of the polar regions provide a comprehensive monitoring system for the maritime and land cryosphere.

As shown in the figure, the Polar TEP platform will include:

Data as a Service (DaaS) – On-demand data sharing through discovery, access, and transportation. Data sets will cover earth observation, air-borne and in-situ sensors, as well as other socio-economic data. The emergence of service-oriented architecture has rendered the actual platform on which the data resides irrelevant.

Information as a Service (InaaS) – The ability to provide standardized and secure methods to create, manage, exchange, and extract meaningful information from all available data in the right format at the right time.

Software as a Service (SaaS) – Delivery and management of applications and tools by PSEP or its users that are used remotely on the platform. Provides users with the capability to deploy user-created or acquired applications.

Infrastructure as a Service (IaaS) – The provision of computing resources, complemented by storage and networking capabilities, as shared resources, scalable on-demand, and enabling cost efficiencies.

Community as a Service (CaaS) – Collaborative tools for users to publish, share and discuss their results, information, data and software/code on the platform. Social networking makes a new level of online collaboration among communities of practice possible.

Iceberg Pilot Project

A Polar TEP pilot project will investigate current and future iceberg risk in Baffin Bay. A diverse set of data, processors and models will be deployed and integrated to allow users to investigate linkages between iceberg populations, observed and modelled changes in ice sheet movement and calving rates, ocean circulation, and iceberg trajectories. The integration of these components and toolsets will allow P-TEP users to ask questions about changing iceberg populations as part of, for example, climate change studies, infrastructure design, or ship routing decisions.

Investigating the Contribution of Antarctic Ice Shelves to 21st Century Sea Level Rise

Application

Antarctic ice shelves play a vital role in the global climate, producing significant water masses that drive ocean circulation and buttressing the rate at which inland ice sheets drain into the ocean. A recent study [RD06] suggests that the Filchner Ice Shelf region in Antarctica might soon experience a wholesale change in oceanographic regime with potentially dramatic consequences for the ice shelf and its tributary ice streams.

A newly initiated large-scale study will use glaciological and oceanographic measurements to improve and validate a set of regional models to predict the regions contribution to 21st Century sea level rise. The lack of the ability to predict these changes was highlighted in the latest IPCC report [RD07] noting the risk of “Abrupt and irreversible ice loss from a potential instability of marine-based sectors of the Antarctic Ice Sheet”. The observational inputs to this study are wide ranging, but will include satellite observations of ice stream surface velocities to be validated by in situ GPS units. Satellite derived data provide important details of spatial and temporal variation in ice sheet and ice stream velocity.

[Figure 4: Filchner Ice Shelf study area showing surface ice sheet and ice stream velocities.]

Role of the Polar TEP

Derivation of ice sheet and ice stream surface velocities is a computationally intensive process that requires large volumes of satellite SAR imagery. To cover the required area and time periods, data from a number of different satellite sensors will be involved. This raises the issue of inter-comparison of velocity data derived from SAR sensors with different characteristics (e.g., how do velocities derived from C-band Radarsat2 data compare with data from X-band TerraSAR-X data?) and using different techniques (e.g., how do velocities derived from interferometry compare with velocities from feature tracking?). The P-TEP will provide capabilities to answer a number of the issues involved.

(a) The P-TEP will provide access to multi-sensor SAR data archives and processing capacity which will allow testing and running of large processing jobs to simplify the effort involved in generating the required velocity fields.

(b) Capabilities in the P-TEP will allow inter-comparison of velocity fields derived from different SAR sensors and the publication of resulting statistics.

(c) Validation of surface velocity data is a critical step. The P-TEP will allow easy integration of in situ GPS data to validate the derived velocity data.

Improving Sea Ice Forecasting by National Ice Centres

Application

National ice centres throughout the world have mandates from their respective governments to monitor and chart sea ice and iceberg conditions in their particular areas of interest. This is a significant activity and involves the manual interpretation of large volumes of satellite data for ice chart production, which is labour intensive, slow and lacks consistency between ice centres as well as inside the same ice centre.

With the large volume of Sentinel-1 SAR data expected from early 2015 onwards, a more automated and rigorous analysis method that allows the combination of SAR, microwave radiometer data, infrared data, scatterometer data and visible data, as well as state of the art numerical weather prediction data is needed.

Current effort is directed at collation of data from multiple sources and (building on the previous development of satellite data assimilation in an ice analysis system) establishing an automated ice analysis system with the aim of being able to produce a regularly updated Arctic wide ice analysis every six hours.

The data assimilation system will build on previous ESA efforts such as SAR Ice constellation (STSE), Sea-ice CCI, SMOSICE etc, since radiative transfer models and backscatter models developed in these projects will be key elements in quantitatively relating satellite observations to surface ice conditions.

[Figure 3: Greenland ice chart produced by DMI.]

Role of the Polar TEP

Development and operations of such a large scale and complex data assimilation system will depend on established access to all required datasets and a programming environment within which to develop, deploy and operate the necessary algorithms. The storage and processing requirements required for this task are significant and most readily provided in close proximity to the required data resources.

In addition production of a regular ice analysis will require regular validation using independent data, which will be more easily achieved within the established processing chain given access to the necessary observation data.

Polar View Sea Ice Information Services

Application

Polar View, originally developed with funding from ESA and now operating independently, aims to continue as the leading organisation for operational satellite-based monitoring of the polar environments and cryosphere. Through many years of service delivery, Polar View services have demonstrated a significant impact on operations safety, environmental protection and sustainable development to a large and diverse group of end users.

Polar View services provide accurate, real time cost-saving information in a number of areas including glaciers, ice edge monitoring, iceberg & sea ice monitoring, lake & river ice and snow cover. These services provide valuable information supporting sustainable economic development, mitigating the risk of accidents in harsh polar environment and informing efforts to monitor and protect the polar ecosystems.

More recently through European funded projects including ICEMAR and Polar Ice, significant improvements are being made to develop new sea ice information resources and to improve the delivery of information to ships operating in the polar regions.

Role of the Polar TEP

A facility such as the proposed Polar TEP has significant advantages for improved service delivery and development of new services. Operational services rely on stable and reliable IT resources to ensure high levels of service performance.

Polar View near real-time information services use a large volumes of satellite imagery that needs to be accessed, processed and delivered as quickly as possible. The Polar TEP will provide fast access to the Sentinel-1 data stream and access to a range of other data resources. Importantly these data will be made available together with processing capacity. This environment will allow service providers to establish services for end users and improve their reliability and performance.

The Polar TEP environment also establishes an environment for development and operation of new information services, making it a key component for supporting commercial and open information services and their end users.

ESA Sea Ice CCI Programme

Application

The ESA CCI Sea Ice project will combine and extend ongoing research to develop improved and validated time series of ice concentration and ice thickness for use in climate research. Since sea ice is a sensitive climate indicator with large seasonal and regional variability, the climate research community requires long-term and regular observations of these key ice parameters in both the Arctic and Antarctic. The ESA CCI Sea Ice project will deliver global data sets to support climate research and monitoring according to the GCOS requirements for generation of satellite-based data sets and products.

Users of sea ice thickness estimates also include commercial players planning ship and offshore operations in ice covered waters. As ice thickness influences loads on structures, it is much sought after during infrastructure design phases and when planning operations.

Advances in the processing of ERS and Envisat radar altimeter data has though shown that these instruments can be used to calculate low-resolution sea ice thickness data from measurements of ice freeboard. In addition to ERS and Envisat, in CCI Phase 2 estimates will also be derived from Cryosat-2 data.

Role of the Polar TEP

Operational processing chains will benefit from easier access to data, combined with access to scalable processing resources.

The Polar TEP is of special interest to the sea ice thickness CCI since the European radar altimeter data is an input both for ice sheet elevation change and sea ice thickness retrieval. Some of the processing steps are identical or easily adapted from one application to another. In addition functionality for sea ice related altimeter data processing (such as sea ice dedicated re-trackers and ice type detection from waveform shape) may also be implemented. Also the iceberg detection from radar altimeter data is based on the same input data and waveform characterisation as sea ice thickness retrieval as the “iceberg echoes” are recognised and discarded from the SIT processing.

Computationally, the heaviest part of the altimeter to SIT chain is the so called “retracking”. A retracker fits a mathematical model to the waveform, and using this model calculates the range representing the target surface.

Lastly, the developers of altimeter sea ice thickness retrieval algorithms would benefit from the TEP. Currently, researchers tend to build and test their tools on a local computer with data downloaded on a local disk. Having a TEP that would allow the testing of their modules (for example retrackers or freeboard to thickness conversion) jointly with other researchers, which would allow the researchers to share and demonstrate their ideas and novel tools within their research community much faster than is currently possible.

Furthermore the Polar TEP should include visualisation and data export tools for sea ice thickness. These will include averaging (both spatial and temporal) of processor outputs.