InSpider

InSpider is a complete system for collecting, transforming, validating and serving (spatial) data. The performance of InSpider is excellent and it is very user-friendly for data managers. InSpider is INSPIRE proof and fully Open Source. The development of InSpider has been commissioned by the joint Dutch provinces (GBO).

Complete package

INSPIDER-Stroomschema-EnInSpider is a complete data pipeline to collect, transform and validate data. Due to the incorporated harmonization data managers may offer their data to the system without any modifications on forehand. The WMS and WFS services are INSPIRE compliant, which amply meet the Quality of Service requirements.

InSpider Highlights

  • Central Data Port for INSPIRE and other datasets
  • Complete ETL pipeline for collecting, conversion and validation of data.
  • INSPIRE compliant download- en view service (OGC WFS en WMS)
  • WFS queries with custom selections 
  • Extensive monitoring and logging
  • Excellent performance and scalability
  • Internal harmonization and  easy configuration using the management console
  • Export to other data formats
  • Extensible with other data types and themes.

Excellent performance

StressTestResultsThe performance of the View Service (WMS) is excellent. When 20 users are working simultaneously, the response time is less than one second. This is much better than the 5 seconds required by INSPIRE. The high performance standard is due to streaming technology of deegree and smart generalization by IDgis. Also the availability requirement of 99% has been amply met by IDgis, due to extensive logging and pro-active monitoring.

Internal harmonization

INSPIDER Attribute mappingData managers may offer their data to the system without any modification of the data or have to restrain their datasets on forehand. The mapping of the data to a uniform structure (such as the INSPIRE structure) is fully done by InSpider. Data owners configure this mapping by using the drag and drop mapping tool of the InSpider manager console. The preview mode shows directly whether the mapping is valid. InSpider automatically skips fields which are not required and datasets are also automatically limited to the right spatial boundaries. Due to this clipping it is not necessary to limit the dataset spatially on forehand.

Automatic Clipping of data-sets

Usecase Dutch Provinces

InsPider was implemented succesfully at the Dutch provinces. A few reactions:

"With InSpider all provinces meet the INSPIRE requirements in one go. Its robust and solid infrastructure for a multiplicity of data sets. Data managers are enthusiastic about the intuitive control of the management console. InSpider means a significant reduction in overhead costs for all provinces. We hope that by means of the Open Source project InSpider will be re-used by other organizations and it will be developed further."

Koen Rutten, Landelijk Functioneel Beheerder bij GBO Provincies.

"For us InSpider is the ultimate solution to have better control over data streams. It is a complete Data Warehouse solution, with a generic set-up. This means that we can use it as a central data system and data hub for a variety of datasets."

Marten Terpstra, Landelijk Data Coördinator GBO Provincies.

Open Source solution and project

InSpider is fully Open Source (GNU General Public License). The system is promising for not only the Netherlands but any country or organization coping with multiple data owners and a diversity of datasets. That's why the joint Dutch provinces and IDgis have decided to introduce InSpider as an open Source project. The goal is to develop InSpider further in good cooperation between users and developers. The InSpider project will become available via GitHub.

More Information

If you want more information or find out what we can do for you, please contact Herman Assink

Herman Assink