News from Mike Collinson, Chair of the OSMF License Working Group:

As promised, and long awaited, the next phase of the OSM License
Upgrade has arrived. Phase 2 – Existing Contributor Voluntary
Re-licensing [1] has begun, and you may indicate your acceptance of
the new Contributor Terms for your existing OSM API account. To
accept the terms visit http://openstreetmap.org/user/terms, (you may
be asked to login first), or your user settings page.

Please note that OpenStreetMap is not changing the license on any
published data at this point. Existing contributors are being asked
to permit re-licensing of their data in the future when it makes sense
to do so.

There is no decline button, and no obligation to answer yet. Existing
Contributor Voluntary Re-licensing is for those who wish to accept the
terms and get on with mapping.

We’ll be publishing which users have accepted so that we can all see
the progress in terms of users and re-licensed data.

We hope that you will accept the new Contributor Terms [2] and ODbL
for each of your user accounts if you have more than one.

** Why are we doing it like this? **

What ifs, what ifs. The key is clearly to reduce these. Those that
simply want to get on mapping and accept that we won’t doing anything
daft, can sign up. Those that are worried about data loss and that
the OSMF will make a stupid decision, can wait and see. We’ll show
how much of the database is potentially covered by the ODbL. We’ve got
some help on modelling that, and we’ll aim for at least a weekly
update if not daily. We’ll also make all the data available needed to
calculate that, so if you want to try a different metric or just see
what is happening in your local area, everything will be transparent.

If you support the share-alike concept, I urge you to accept the new
Contributor Terms which provides for a coherent Attribution,
Share-Alike license written especially for databases. If you are a
Public Domain license supporter, we are divided as a community on
which is best and I do urge you to give this one a good try. The
Contributor Terms are expressly written to allow us to come back in
future years and see what is best without all this fuss about
procedure. And if you’d just really like all this hoo-haa to go away
and get back to mapping, well, please say yes.

** Some supporting notes: **

() The key thing is that there are about 12,500 contributors who have
contributed over 98% of the pre-May data.

() I personally really, really want to get a coherent license in place
so that my mapping efforts are more widely used. I also really, really
don’t want us as a community to shoot ourselves in the head and
divide. I pledge to continue working with *both* objectives in mind.

() The License Working Group will not recommend switching over the
license if data loss is unreasonable [3]. We will issue a formal
statement to that effect and are attempting to define better what
“unreasonable” means. A totally quantitative criteria is extremely
difficult to define ahead of actually seeing what specific problems
may arise. But I understand the concern that we are tempted to do
something wild.

() The License Working Group will ask the OSMF board to issue a
similar statement.

() We are working to create a process whereby we can model on a
regular basis how much of the OSM database is covered by ODbL and how
much not. We will make all the data needed to do that public so that
anyone can analyse using their own metrics. Work on this is active and
being discussed on the dev mailing list. You will need:

– An ordinary planet dump.
– Access to history data. A public 18GB “history dump” is available
http://planet.openstreetmap.org/full-experimental/full-planet-100801.osm.bz2.
The intent is to make this available on a regular basis with difffs. A
full re-generation takes several days.
– A list of userids of who has and has not accepted the license. Work
in progress.

() A final vote on whether to switch or not remains an option. But let
us see first if “data loss” really is an issue and what the specific
problems might be.

Regards to all,
Mike
License Working Group

[1] http://wiki.openstreetmap.org/wiki/Open_Database_License/Implementation_Plan#PHASE_2_-_Existing_Contributor_Voluntary_Re-licensing_.28started_10th_August_2010.29

[2] The new Contributor Terms:

http://www.osmfoundation.org/wiki/License/Contributor_Terms_Summary – Summary

http://www.osmfoundation.org/wiki/License/Contributor_Terms – Full
text and links to translations

[3] https://docs.google.com/View?id=dd9g3qjp_76gwvhpcx3 License
Working Group minutes, see Item 7

Despite the discussion resulting from my post yesterday, there continue to be individuals on the talk@ mailing list disrupting the community.

I would personally like to reach out to John Smith as one of the people who seems to have cooled off, and thank you.

I have posted Andy’s draft etiquette to the wiki

http://wiki.openstreetmap.org/wiki/Etiquette

Specifically, I point to the basics of mailing list etiquette:

Mailing Lists
• Assume good faith
• Stay on topic
• No conspiracy theories
• No grandstanding
• If you’ve made your point already, you don’t need to tell us all again
• Nitpicking doesn’t help you or anyone else
• Learn to live with the reply-to setting. We’re not changing it, no matter what your opinion is and so on.

Having had deep discussions with many key people in OSM, asked for their advice and direction, I reluctantly appoint myself Benevolent Dictator For Life.

As BDFL, I hereby give warning that in 24 hours time I will begin enforcing these etiquette guidelines. Specifically, anyone who continuously and deliberately breaks the guidelines, despite warnings, will be moderated off the list for a 24 hour ‘cooling off’ period. If after this cooling off period, further continuous and deliberate breaches occur, despite warnings, additional cooling off periods will be enacted growing exponentially with each time. For example, 24 hours cooling off, then further breaches, then 48 hours cooling off, then further breaches, then 96 hours and so on.

This is not about squashing dissent. If you disagree with others license opinions, legal-talk is there for you. If you want to join a Working Group, you still can. If you want to create a PD OSM project, you have all the source and mailing lists are freely available around the web.

This is purely about restoring the mutual respect and balance of the talk@ mailing list, and not allowing a few to disrupt the main channel of communication to the point where the vast majority no longer find discussion worthwhile.

I plan only to moderate people (for 24 hours) after taking a poll of key people including Andy Allan, Matt Amos, Katie Filbert, Tom Hughes, Emilie Laffray, Frederik Ramm, Ivan Sanchez, Grant Slater and Richard Weait. If you think more than these would be good then let me know. Any moderation will be announced to those people I just mentioned, and not publicly. Why not publicly? On balance, it seems better to not call out individuals publicly which might only make things worse and make them feel more upset, which is not the purpose of a ‘cooling off’ period. Any one of those people I announce it to could announce it publicly if they want to.

I am happy to listen to a different panel, if one constitutes itself. If I have full confidence in said panel, I’ll consider handing over the power and stepping back.

As BDFL I still have limits upon my power. You can vote me out of the OSMF. You can convince the server team to change the mailman password so I can no longer moderate. I am also imposing a self-limiting, four week (28 day) period starting from when this warning period ends (in 24 hours) whereby, if I don’t exercise my BDFL powers during that time, I will step back.
So, please, have a think about what and where you are posting, and lets make talk@ a nice place to be again.

Steve

stevecoast.com

OSM is mostly a consensus-based community, or a do-ocracy. It was never a benevolent dictatorship, and I have given up (as far as I know, anyway) all power I have in OSM. I used to write the code, own the domain names, run the mailing list(s), run the servers, evangelize, talk to the press and so on. I’ve successively and successfully given up those rights to very capable individuals. However this has led to a power vacuum when it comes to making some key decisions because nobody, for example and in a sense, is “in charge” of everything. For the most part I’ve enjoyed giving up control and seeing the project blossom, because it wouldn’t have if I hadn’t.

However, things break down in a consensus-based community if you don’t have a way to deal with malcontents.

As background to the topic of this post, there is a nice video on how open source projects can survive poisonous people on youtube here:

[youtube http://www.youtube.com/watch?v=ZSFDm3UYkeE?wmode=transparent]

It’s about an hour long so I’ve provided a summary I made while watching it again at the bottom of this post. It’s thesis is that you need to understand the problem of poisonous people, fortify your project against them, identify who they are and ultimately remove them.

The talk above identifies people who are poisonous as those who appear with traits (amongst others) of obviousness that they will suck and drain your time, use silly nicknames/email addresses, are hostile, make demands and blackmail threats, make sweeping claims, refuse to acknowledge reasoned argument, make accusations of conspiracy and reopen topics continuously.

One quote from the talk in particular comes to mind: “it’s a technique that poisonous people can use to derail a consensus-based community from actually achieving consensus. You have this noisy minority make a lot of noise and people look and say ‘oh wow there is no agreement on this’ and if you look carefull the ‘no agreement’ comes from one person while seven or eight people actually agree”

With that in mind, take a quick look at the recent discussions on the main mailing list link. I won’t point to an individual thread or post, it’s easy enough to figure out:

http://lists.openstreetmap.org/pipermail/talk/2010-August/thread.html

Without discussing the individuals or the topics of the conversations, it is clear to me we are infected by poisonous people. This is bad because as the talk above specifies in the ‘comprehension of the problem’ section, such people distract, drain, paralyze, slow cause needless infighting and destroy the attention and focus of a community.

I know this first hand. Many (if not most or all) of the key people in OSM are feeling drained, distracted and upset. Some are talking of hiatus or resign. These are the key people who write code, build things, maintain things and run our working groups.

There is a tipping point between which our working groups and individuals have the time and patience to deal with poisonous people and the work they cherish doing, which are the things that make OSM work every day.

The discussions have spilled over now from poisonous people merely making life difficult on the mailing list, to paralyzing the project and even systematically corrupting the data we serve out using bots. This is not to say there are not good points in the discussion, good points being dealt with by the License Working Group or others either in meetings or on the mailing lists, but these are being buried by poisonous people on the mailing list and elsewhere. Personal communication from multiple people, public discussion, phone calls and more have been tried without effect.

This destroys consensus-baesd community.

So we are at a point now in OSM, I believe, where a few poisonous people are wrecking the time, focus and goodwill of the majority of contributors, creating dissent out of nothing and even purposefully breaking our data. And we don’t have a clear process to deal with all the factors. The Data Working Group is one piece of the puzzle, but is not responsible for curtailing the mailing list going in infinite circles.

Worse – it’s giving the project a bad air to outsiders, both newbies and those outside the project. It’s stopping people from becoming more involved.

Thus we need some kind of process for calling timeout on people in the project, blocking them for a limited time. This could range from electing individual mailing list admins with a remit of when to shut down discussions (much like an IRC chat admin(s)), to more clear and actioned policies on list etiquette (like forcibly keeping legal discussion to the legal list), to an ejection committee to me just appointing myself benevolent dictator and blocking people for a limited time out cooling off period based on advice from the community (a worst case option I’d like to avoid).

Let’s be clear – we’ve tried all the nice things. We’ve sent nice emails. We’ve sent nice emails privately. We’ve offered phone calls. We’ve offered every rational debate and community consensus tool we have. We just have poisonous people that either need to cool off or be forcibly blocked for a time.

We need to restore the balance of healthy debate over important issues, restore the time and focus of existing contributors and restore the positive view outsiders and newbies of the project are used to.

I’m posting this to three places on purpose with different audiences: opengeodata, osmf-talk@ and talk@. I will undoubtedly be flamed here for being authoritarian but at the end of the day someone has to do it, and begin this process. I’ve purposefully left out individual names, details and links to keep this discussion to the key thing – how and why should we block people. If you want those details, just reply to this post and someone will probably tell you publicly or privately.

What are your ideas? How should we block people? For how long? What process should it be? What are the best practices from other projects you’re involved in?

Summary of the poisonous people talk:

comprehension – understand the problem of poisonous people
– you need to protect the attention focus of community – limited amount of time
– poisonous people
– distract
– emotionally drain
– cause needless infighting
– slow you down
– either on purpose on by accident

fortification – protect project from poisonous people
– in a project you need politeness, respect, humility, trust
– have a mission, with examples
– have a scope, limit the mission
– do not let people reopen old discussions
– don’t reply to _every_ message in a thread, summarise
– poisnous people derail discussion:
“it’s a technique that poisonous people can use to derail a consensus-based
community from actually achieving consensus. You have this noisy minority
make a lot of noise and people look and say ‘oh wow there is no agreement
on this’ and if you look carefull the ‘no agreement’ comes from one person
while seven or eight people actually agree”
– document your projects history for future use to point people to
– have code collaboration guidelines
– email review, reasonably sized patches
– increase the bus factor so if someone drops out, others can take over
– have well defined processes for
– releasing software
– test / release cycles
– admitting new core people
– voting is a last resort in a healthy community
– everything else should be tried before a vote

identification – who are the poisonous people?
– it’s usually obvious who will suck and drain your time
– usually use silly nicknames
– use CAPITAL LETTERS, !!!?!?!one!!, WTFLOLOMG
– hostility, demands help, blackmail, rile people deliberately
– accusations of conspiracy
– conceit, refuse to acknowledge arguments
– sweeping claims, reopen topics continuously
– lack of cooperation

disinfection – removing the poisonous people
– assess the damage
– how are they affecting your attention and focus?
– are they distracting / paralysing the project?
– _dont_
– feed the troll
– give jerks a purpose/purchase
– get emotional (stick to the facts)
– _do_
– pay attention to newcomers, even if annoying
– look for the fact under the emotion
– extract real bug report / action
– know when to give up and ignore
– know when to boot from community

Steve

stevecoast.com

Jhabjan’s map of Sinj, Croatia, printed for tourism office. Aerial
images were donated by local aerial club.

This is a Featured image, which means that it has been identified as
one of the best examples of OpenStreetMap mapping, or that it provides
a useful illustration of the OpenStreetMap project.

If you know another image of similar quality, you can nominate it on
http://wiki.openstreetmap.org/wiki/Featured_image_proposals

Monsoon flooding continues in Pakistan following what has been called
the heaviest rains in 80 years. As many as 12 million people have
already been affected and over 1600 are known dead to date. The
availability of up to date aerial imagery has been hampered by the
continuous cloud cover. New flood warnings are announced often, and
the rains are continuing. Lists of dead and missing, additional
flooding, displacements and injury seem overwhelming. It is expected
that disease will become a very serious issue as access to clean water
is reduced.

http://www.thenews.com.pk/top_story_detail.asp?Id=30580
http://www.csmonitor.com/World/Asia-South-Central/2010/0806/Pakistan-floods-d…
http://www.bbc.co.uk/news/world-south-asia-1088
http://www.earthtimes.org/articles/news/338523,relief-efforts-summary.html9925

OpenStreetMap has some data in some of the affected areas. You might
help by donating money to an international relief agency. And you
might help by participating in mapping the flooded areas from aerial
imagery.

http://wiki.openstreetmap.org/wiki/2010_07_Pakistan_Floods

http://wiki.openstreetmap.org/wiki/2010_07_Pakistan_Floods/Mapping_Coordinati….26_Towns

Photo from The News, http://www.thenews.com.pk/top_story_detail.asp?Id=30580

Distribution of k:natural; v:tree nodes in Szczecin. Poland,
contributed by the city’s cadastre bureau.

This is a Featured image, which means that it has been identified as
one of the best examples of OpenStreetMap mapping, or that it provides
a useful illustration of the OpenStreetMap project.

If you know another image of similar quality, you can nominate it on
http://wiki.openstreetmap.org/wiki/Featured_image_proposals

Terry Stigers was inspired
by Steve’s post the other day. He responded with an interesting article
which includes what should become the motto of every Map Dork. I
won’t steal Terry’s thunder and have quoted the article in part here:

Anyway, I got to thinking about a discussion I had with a
fellow Map Dork on Twitter a short while ago, about data and GIS.
About how the majority of the GIS community spends the bulk of its
time thinking about what to do with data, and not enough time thinking
about the quality of the data itself.

It’s like this – whenever I make a map, there are two primary
components involved in the process. The first is the software that
produces said map. [ … ]

The second component of any map I make is the data with which I make
the map.

The details matter, so you should go and read the rest of Terry’s article now.

http://wherewithal1.wordpress.com/2010/08/03/why-i-love-openstreetmap-and-you-should-too/

They create oxygen in our cities and provide welcome shade from the
sun or temporary respite from a summer shower. There are trees urban
areas and sometimes they should be put on the map. How do you place a
noble Oak on OpenStreetMap? You follow the link to Project of the
Week!

More details and tagging suggestions for this Project of the Week:
http://wiki.openstreetmap.org/wiki/Project_of_the_week/2010/Aug_01

This is your Project of the Week. Make suggestions. Inspire other mappers.
http://wiki.openstreetmap.org/wiki/Project_of_the_week/Proposals

Tree photo by fr4dd http://www.flickr.com/photos/fr4dd/
Licensed ccby http://creativecommons.org/licenses/by/2.0/deed.en_CA

I want to nip something in the bud before it gets too sexy to repeat by the geo-intelligensia who’re being herded in to place by the jetset geospeaking crew.

Here’s the basic argument: “openstreetmap is closed because the ordnance survey released data under a ‘more open’ license.” there are a bunch of obvious ways of rephrasing it.

It sounds simple, it’s a nice meme that will take hold with an audience. It’s one of those “Oh wow! A deep and logical point I haven’t thought of before” kind of mind bombs you get in a Malcolm Gladwell book. You can grin and snicker with your friends at the pub: Those silly OSMers! They aren’t even open. They’ve been leapfrogged by good old central government planning! If only they were _truely_ open, then we could all use the data!

Let’s strip this apart.

First, it’s a false dichotomy. That means they’re reducing OSM to one of two states namely ‘open’ and ‘closed’ when in fact there is a spectrum in between. There are many, many open source licenses which fan out between non-commercial with some sharing rights, right through to the public domain which allows you to do virtually anything you like. Using extremely loaded terms like ‘open’ and ‘closed’ is a false dichotomy. It’s a neat hand wavy argument designed to make the speaker look intelligent when comparing, actually, apples and oranges which we’ll get on to in a second. Everyone has a happy place on the license spectrum and this isn’t a point about where you the reader lay on that line, but a point about framing the argument in to two unrelated positions to make it look simple when it isn’t. And then be witty by positioning OSM on the closed end. Which it’s not.

Next let’s look at the type of data we’re comparing. This gives them some wiggle room to say “oh we didn’t mean the OS data but this other improbable dataset over there”. But let’s stick with the wonderful Ordnance Survey data release. You can’t easily compare the OS data release and OSM data for multiple reasons.

One is that OSM is a moving target. The OSM data is improving continually from the work of a large and diverse community behind it. The OS data is not. It is improving, granted based on a lot of employee surveyors, but there’s no guarantee (correct me if I’m wrong) that you will still have open OS data up to date in 2015. OSM has that guarantee. It’s in the license. We can’t fork OSM in to a proprietary stack. You (if you’re the OS) can fork the OS data, and of course they very reasonably do. They have a copy they can license to whoever they like under whatever terms, and also the open copy. Those aren’t guaranteed to be the same thing in perpetuity. The free version might start to lag the proprietary one. The free one might cease to be released. You have no idea, and no control over that. With OSM you have every control and every assurance that it will always be open.

Here’s some more simple kickbacks – OSM is global not just in the UK. OSM maps more types of things than the OS maps. OSM has a community around it of tools and software and mappers. Stop and think for a second – would you get all of those things under a ‘more open’ license? The answer is not very clear and I suspect the answer is no, but everyone has an opinion on that.

So the datasets are different. You can’t compare apples with oranges, the GDP of a country with the market cap of a company, or a free and open global community continually improving data with a point release of a single dataset in one nation.

Now dear reader, allow me to make my own cheap shot. The very people dancing around with this argument tend to work for large companies…. with large proprietary datasets. Perhaps Google could release the MapMaker data? Or perhaps Nokia could release their NavTeq data? Ghandi wanted us to become the change we wanted to see in the world. That means beginning at home. Surely we should be hearing more from the valiant geovisionaries during their globetrotting speaking tours (speaking as a globetrotting speaker) about their fine efforts at home to release large chunks of data? Say under an ‘open’ license like the OS did? Sadly I find silence on this issue, but it’s not a surprise. Oh and putting on your blogs and talks that everything is your personal opinion doesn’t make all these arguments disappear guys.

Richard Stallman has many failings as we all do, but one thing he repeats resonates with me on OSM – don’t give up the long term vision for some short-term gains. To me that means not moving to public domain because one company might donate some data to us, or staying with another license because another will. There are other, valid, arguments for those moves but a short term gain is not. These are admittedly very attractive offers. Imagine if we moved to license X and Google gave us a lot of aerial imagery, or license Y and Nokia delivered us to the promised land.

But wait a minute, if they believed in those things then surely they’d gift them to us anyway? That’s rarely the case. And I applaud those who do, like Yahoo and AND for example.

What you’re seeing is that OSM is somewhere like one third or one half way toward real maturity. Time is very skewed. In some ways the 6 years we’ve existed looks like a very long time to those involved. If only we could get things quicker by changing the fundamental structure of OSM so that they would, perhaps, grant us some data (for that is often the offer)? On the other hand, 6 years compared to the timespan the OS took to map the UK, or any company or agency took to map a dataset as large as OSM… is tiny. We’re talking 6% of the time in some cases. Yes, it can take 100 years to map. Many datasets are built quicker, but very very few on the order of 6 years. Globally. For free. Then released for free.

As we’re in this midpoint somewhere and the pillars of proprietary data begin to collapse around us you see panic. You see people propping them up with beams. You see new temples built of wood made to look like stone. You see a general shoring up of an obsolete structure and in the general thrashing around you see a lot of people looking for someone to blame while they hold on until a secure future arrives.

And who shall we blame and poke? Google? Inscrutable. Nokia? They make phones.

No, OpenStreetMap will be kicked and get the blame. We’re the easiest target, with the most to lose. As far as I can see the cheap ‘OSM isn’t open’ arguments are just a way to deflect attention from the pillars falling: Think not of us releasing our vast datasets, think instead of OSM not being open. Think not of us contributing, think instead of changing OSM and allowing us to use it as we see fit – perhaps then we will contribute. Think of us as not evil, think of OSM as splintered, hemorrhaging and not as united as us.

If you have some of that OSM vision then you should be thinking about where OSM will be in another 6 years, not what we have to give up to appease those who’d love our data without attribution or reciprocal rights. It will be okay. Relax. In a few years it will look silly that anyone ever thought we should give up our values for some quick data injections.

OpenStreetMap has a challenge rebutting all these arguments. It’s tiring. We’re nice people. We have better things to do. We speak with many voices, each with a different view on key things like licensing, whereas those guys have voices almost in choral harmony. But don’t mistake that quiet for some kind of general acceptance. We haven’t been sleeping while you suddenly decided OSM was ‘closed’.

So, dear reader, the next time you see a talk or blog post where OSM is darkly described as ‘closed’ feel the strength to ask if the speaker works for a company with a vast proprietary dataset and if they’d like to discuss opening it, or perhaps if they have any experience whatsoever in open projects, licensing or building communities. If they mutter about their legal team not being comfortable with OSMs license, you can invite them to look at all the other ginormous companies using OSM who are perfectly comfortable.

Oh, and say hi from me!