Category Archives: Operations

Hardware and system administration related posts. Anything related to the Operations Working Group

OpenStreetMap Enhances User Privacy

Today, OpenStreetMap has enabled encryption (SSL) to all of the openstreetmap.org website, thereby enhancing the privacy of its users.

You can now browse the site at https://openstreetmap.org (note the ‘https’). This means your browsing activity is secure from snooping.

OpenStreetMap stands with the Open Rights Group and the Electronic Frontier Foundation in asserting greater Internet freedom, including the right to individual privacy. With this action providing the highest quality Free/Open Data Geographic resource to everyone.

We are proud to roll this out on the same day as the “Day We Fight Back” campaign.

Other aspects of privacy around OpenStreetMap are discussed on this wiki page.

OpenStreetMap infrastructure donation – Bluehost

Thanks to generous donations and active local community members, the OpenStreetMap distributed tile delivery infrastructure continues to grow.

Two tile servers, nadder-01 and nadder-02, have been added to the OpenStreetMap tile cache network.  Based in Provo, Utah, USA, these servers provide tiles to the Americas.

Map tiles are delivered to users based on their GeoDNS location. The OpenStreetMap Foundation seeks additional distributed tile servers. If you would like to donate a tile server and hosting, please see the Tile CDN requirements page on the wiki.

tile serving geodns map

We would like to thank the BOSS team (Bluehost Open Source Solutions) and especially Jared Smith at Bluehost.com for this generous donation to OpenStreetMap infrastructure.

The OpenStreetMap Foundation is a not-for-profit organization, formed in the UK to support the OpenStreetMap Project. It is dedicated to encouraging the growth, development and distribution of free geospatial data and to providing geospatial data for anyone to use and share. The OpenStreetMap Foundation owns and maintains the infrastructure of the OpenStreetMap project. You can support OpenStreetMap by donating to the OpenStreetMap Foundation.

New tile rendering and CartoCSS stylesheet

The default OpenStreetMap.org “standard” map was switched across to a new rendering server setup over the last weekend.

In addition to new hardware, the rendering server also uses the new “openstreetmap-carto” stylesheet. This is a complete re-write of the old XML stylesheet to use CartoCSS, making it easier for our cartographers to work with. The style is designed to look as similar as possible to the old XML stylesheet.

Andy Allan presented a great talk at State of the Map US conference describing the reasons for re-writing the stylesheet: Putting the Carto into OpenStreetMap Cartography

Andy Allan Stylesheets

Andy will present a follow-up at State of the Map next month.

The “openstreetmap-carto” stylesheet is maintained on github

“openstreetmap-carto” is a good base for creating custom styles, and should be much easier to work with. If you want to help improve the style, or add new features, please fork it and contribute pull requests!

Please support OSM’s server hardware fundraising drive

Bulk GPX track data

Last year, at about this time, the OpenStreetMap Foundation made a big splash when it released the first Bulk GPS Point dataset. That may have been the largest publication of GPS point data ever. Many users were thrilled to have that raw data and to put it to good use. But they also wanted more. They wanted the track file details.

In fact, requests for bulk OpenStreetMap GPX track files go back to 2007 or earlier. Now, the combined talents of the OpenStreetMap community and the resources of the OpenStreetMap Foundation, make that dream a reality.

Announcing the GPX Planet

The scale of this dataset is fairly large.

  • 848,000 GPX files
  • 2.6 Trillion GPX points
  • 260GB of GPS data (uncompressed)

Not everybody will be able to manage all of this data at once. It is likely, as with planet files and planet extracts, that somebody will offer GPX extracts.

What is this data good for?

Well, it’s interesting and there is a large quantity of it. Many OpenStreetMap contributors have been asking for it for years. Previous uses for this type of data have included

  • artistic organic trip data as maps
  • confirm turn restrictions
  • confirm one-way restrictions
  • confirm speed limits
  • and many more of your ideas in the comments

The future

There are hopes and plans to improve this service over time, including

  • quarterly updates
  • addition of vdop / hdop precision data, where available

You can help

You can help to improve this service by contributing your GPX track data. Upload your GPX files through your OpenStreetMap account. Collect new track files as you survey.

You can also help by using the data for something interesting and / or by publishing some code. OpenStreetMap user Zverik has started the ball rolling by creating gpx2pgsql to put the gpx data into your rendering tool chain.

Thanks

Thanks as always to the million-plus OpenStreetMap contributors over the eight years of the project so far. Especially, thanks to the thousands of contributors who collected and uploaded their GPX track files, and to Lars Franke, who wrote the first Java GPX dump code in 2010, and to Ian Dees who rewrote that into the current Python code, and to the many others who were involved in ways large and small.

So, where is it?

Find the GPX planet on the planet site and mirrors.

The image in this article is a visualization of some of the GPS point data in Europe. The image is licensed CC-By-SA and was created by Dave Stubbs.

Database maintenance

Updates included below the original post.

OpenStreetMap database unavailable on 31 March 2013

There is a current problem with the OpenStreetMap database and so the data API is currently unavailable due to hardware failures.

The current issues were first observed early on 31 March 2013 when the primary database server became non-responsive. The system administrators are aware of the problem and will resolve it as soon as possible. A complicating factor is the observation of a holiday at the hosting facility that prevents physical access to the server until Tuesday morning.

With the database unavailable, editing is not possible. Other database-related activities, such a new-user-signups, are also unavailable.

Other non-database-related services should operate normally. Tiles are being served with current data.

The system administrators will continue to take steps towards the return of normal operation. Given the aforementioned holiday at the hosting facility, normal operation may not return until some time Tuesday, 02 April 2013.

2013-03-31 1810 UTC – Admin on site

One of the OpenStreetMap Foundation hard working system administrators is currently on-site at the hosting location and working on a solution.

Thank you to the facility and everybody involved for permitting access during the holiday.

Corrective actions are in progress. Services are not yet restored. Stay tuned.

2013-03-31 1900 UTC – Return to normal operation

The database has been returned to normal operation. All OpenStreetMap services should be operating as expected.

Thanks again to the admin team and our hosting providers for the prompt resolution to this unscheduled outage.

Scheduled Maintenance – 08 March 2013

Some OpenStreetMap services will be off-line on 08 March 2013 for scheduled maintenance.

The OpenStreetMap Foundation, Operations Working Group advises that on 08 March 2013, scheduled maintenance of OpenStreetMap services will occur from approximately 0900H to 1600H UTC. The following service changes are expected:

  • API read-only from 0900H to 1500H UTC
  • Diffs off-line from 0900H to 1500H UTC
  • Wiki off-line/read-only from 1000H to 1600H UTC

The scheduled maintenance includes upgrades for the database server and improvements for the wiki server. Some more specifics given on the wiki. Actual service times may vary within the service windows described above.

Thank you, in advance, for your patience and understanding during the maintenance window.

Thank you, as always, to the Operations Working Group, for their tireless efforts that keep OpenStreetMap services working smoothly.

Two More New Tile Servers

Thanks to generous donations and active members of the OpenStreetMap community, OpenStreetMap infrastructure continues to grow.

A new tile server, Trogdor, has been added to the OSM tile cache network. Located in Amsterdam, The Netherlands, Trogdor is currently serving tiles to IP addresses from The Netherlands, Belgium and several other central European and central African countries.

A second new tile server, Ridgeback, has also been added to the OpenStreetMap tile cache network. Located in Oslo, Norway, Ridgeback is currently serving tiles to IP addresses from Finland, Iceland, the Faroe Islands and several others.

The list of countries served by any tile server will change over time due to expansion of the tile server network, loading, maintenance activities and other factors.

Map tiles are delivered to users based on their GeoDNS location. The OpenStreetMap Foundation seeks additional distributed tile servers. If you would like to donate a tile server and hosting, please see the Tile CDN requirements page on the wiki.

We would like to thank Blix Solutions AS for this generous donation to OpenStreetMap infrastructure.

The OpenStreetMap Foundation is a not-for-profit organization, formed in the UK to support the OpenStreetMap Project. It is dedicated to encouraging the growth, development and distribution of free geospatial data and to providing geospatial data for anyone to use and share. The OpenStreetMap Foundation owns and maintains the infrastructure of the OpenStreetMap project. You can support OpenStreetMap by donating to the OpenStreetMap Foundation.

Photo Credit. This photo of the Oslo tile cache server is kindly provided by Blix Solutions AS, licensed CC-By-SA and used by permission.

New aerial imagery – South Africa

A small sample of the South Africa aerial imagery provided by CD:NGI, the mapping agency of the government of South Africa.

OpenStreetMap contributors in South Africa have negotiated with the South African government to arrange the donation of some aerial imagery to be used in creating and editing data for OpenStreetMap. Chief Directorate: National Geo-Spacial Information, or CD:NGI, part of the South African Department of Rural Development and Land Reform, have provided aerial imagery and OSM contributor Grant Slater, has prepared it for use in our editors. There is 3TB of imagery and covers all of South Africa.

Thanks as always to the many people who helped make this happen: the fine folks at CD:NGI, the OSM contributors who carried the data between continents, and the mappers who continue to make OSM data better, more up to date and accurate every day.

You can find more information about this aerial imagery in the thread on the talk-ZA mailing list.

Do you want to donate aerial imagery or other data to OpenStreetMap? Contact the OSM Foundation Communication Working Group for more details. communication@osmfoundation.org

The OpenStreetMap Foundation is a not-for-profit organization, formed in the UK to support the OpenStreetMap Project. It is dedicated to encouraging the growth, development and distribution of free geospatial data and to providing geospatial data for anyone to use and share. The OpenStreetMap Foundation owns and maintains the infrastructure of the OpenStreetMap project. You can support OpenStreetMap by donating to the OpenStreetMap Foundation.

New Tile Server in Pau, France

Thanks to generous donations and active members of the OpenStreetMap community, OpenStreetMap infrastructure continues to grow.

A new tile server, Lurien, has been added to the OSM tile cache network. Located in Pau, Pyrénées-Atlantiques, France, Lurien is currently serving tiles to IP addresses from France, Spain, Portugal, Andorra, Gibraltar, Italy, Monaco, San Marino and Vatican.

Lurien, highlighted.

Map tiles are delivered to users based on their GeoDNS location. The OpenStreetMap Foundation seeks additional distributed tile servers. If you would like to donate a tile server and hosting, please see the Tile CDN requirements page on the wiki.

We would like to thank PauLLA with support of Université de Pau et des Pays de l’Adour (UPPA) for the server and connectivity and Communauté d’Agglomération de Pau Pyrénées (CDAPP) for the data centre hosting. We would also like to thank OpenStreetMap contributor Christophe Merlet for arranging the donation.

The OpenStreetMap Foundation is a not-for-profit organization, formed in the UK to support the OpenStreetMap Project. It is dedicated to encouraging the growth, development and distribution of free geospatial data and to providing geospatial data for anyone to use and share. The OpenStreetMap Foundation owns and maintains the infrastructure of the OpenStreetMap project. You can support OpenStreetMap by donating to the OpenStreetMap Foundation.

New Tile Server in Moscow

For the second time this month, the OpenStreetMap Foundation has a generous donation of OSM infrastructure to announce.

A new tile server, gorynych, has been added to the OSM tile cache network.

We would like to thank Yandex for providing the new tile server in Moscow. We’d also like to thank the local OpenStreetMap community, especially Dmitry, who was instrumental in the Yandex donation.

Map tiles are delivered to users based on their GeoDNS location. The OpenStreetMap Foundation seeks additional distributed tile servers. If you would like to donate a tile server and hosting, please see the Tile CDN requirements page on the wiki.

Yandex is the leading internet company in Russia, operating the most popular search engine and the most visited website. Yandex also has demonstrated support for Open projects by hosting a mirror for Linux distributions and other F/LOSS projects and a jabber server.

The OpenStreetMap Foundation is a not-for-profit organization, formed in the UK to support the OpenStreetMap Project. It is dedicated to encouraging the growth, development and distribution of free geospatial data and to providing geospatial data for anyone to use and share. The OpenStreetMap Foundation owns and maintains the infrastructure of the OpenStreetMap project. You can support OpenStreetMap by donating to the OpenStreetMap Foundation.