Showing posts with label open data. Show all posts
Showing posts with label open data. Show all posts

Thursday, August 14, 2014

NSW highlights open data as one of four focuses in the Premier's Innovation Initiative

The NSW government today launched the NSW Premier's Innovation Initiative, a program seeking expressions of interest in projects that support NSW government innovation in four focal areas - Congestion, Social Housing Assets, Open Ideas and Open Data.

The process will invite organisations and individuals to submit Expressions of Interest setting out proposals the government could consider in one or more focal area.

Following this, selected respondents will be invited to submit full proposals for funding and implementation consideration.

While this process is far more complex and bureaucratic that similar processes I've seen run in the US, UK and other nations , it is great to see a government in Australia taking the step to formally ask the community for ideas and proposals to improve aspects of the state and government.

The inclusion of Open Data is quite notable. This looks like a genuine and sophisticated attempt to accelerate the NSW open data agenda, involving the consumers of the data in the process of defining what data is released and how.

Given the significant economic value attributed to opening up public sector data it is good to see both the attention and the funding placed behind this initiative - in too many cases we see only one, or neither of these, with open data catalogues run on a shoestring and their managers required to cajole and beg government agencies into participating by supplying data.

Read full post...

Wednesday, August 13, 2014

ACT Crime Stats data - ready for people to analyse and mashup

At GovHack a few weeks ago my team, The Hack Warriors, wanted to integrate ACT crime data into our project 'Where Should I?'

While the ACT makes the data available visually in the awesome Crime Statistics site, it wasn't available as open data from data.act.gov.au.

So during the weekend I went through the code for the Crime Statistics site and (with a little help) identified where the data was coming from. I was able to download the actual Crime Stats data and process it into a spreadsheet with all the figures by suburb.

For reuse purposes I put the data up as a public Google Fusion table, which anyone can now access via a search of Fusion tables, or via the direct web address: https://www.google.com/fusiontables/DataSource?docid=1Cztgi-LF4CtXtS-EbU1M6JXnZAzPt1wLAH5YdXnN#rows:id=1

What this means is that now anyone who wants to mine the crime statistics for the ACT can do so easily using this table - performing statistical analysis or mashing it up with other data and mapping it easily.

Even better I found that while the ACT Crime Statistics site allowed people to see data back to 2010, the actual data went all the way back to 2007 - providing more historical data than is visually available from the site.

So if you want to play with the actual numbers behind the ACT's Crime Statistics site - you could start with the table below.




Read full post...

Sunday, August 10, 2014

GovHack 2014 Red Carpet Awards liveblog

Tonight I am attending the GovHack 2014 Red Carpet Awards night in Brisbane, and will be liveblogging the proceedings.

Keep an eye on my live blog (below) and the Twitter hashtag #GovHack for all the winners and happenings.

Live Blog GovHack Red Carpet Awards 2014
 

Read full post...

Friday, August 08, 2014

GovHack 2014 winners to be announced on 10 August

GovHack 2014 was the largest open data in Australian history.

With over 1,300 participants across 10 locations, it set a new benchmark for engagement with, and reuse of, government data.

On Sunday evening the winners will be announced at a Red Carpet Awards Night in Brisbane. I'll be attending and liveblogging & tweeting the event, so keep an eye on eGovAU and on the hashtags #govhack, #govhackau and #govhack14.

If you want to check out the entries before the event, visit the complete list of GovHack projects at http://hackerspace.govhack.org/

Don't have time to look through 200-odd projects?

Here's some that the GovHack team has particularly noted (note this doesn't mean they will necessarily be finalists, there's a lot of good projects):

Read full post...

Monday, August 04, 2014

Get ready for the GovHack Red Carpet Awards night

This Sunday GovHack returns with the 2014 GovHack awards night.

With an exclusive Red Carpet Award event in Brisbane, and local events across Australia, it should be a great night to see which teams win the top GovHack awards for the year.

The invitation only red carpet event will be streamed nationally from the Brisbane City Town Hall from 7pm on August 10 (see video feed below).

The event will feature Adam Spencer as Master of Ceremonies, senior representatives from participating Federal, State, and Local government jurisdictions as well as many of the finalists - over 200 people in all.

I will be covering the event in Brisbane, and with over 200 entries into GovHack, there should be plenty of excitement as the National and Local winners are announced.

A complete list of GovHack entries is available online, and you can still vote for the People's Choice winner at http://hackerspace.govhack.org

Read full post...

Monday, July 14, 2014

Round up from GovHack 2014

GovHack is over for 2014, with teams finishing their hacks by 5:30pm on Sunday, 13 July.

With over 1,200 participants organised into 178 teams, 204 projects were developed in under two days, with 146 projects (based on my count) eligible for the approximately $70,000 in national prizes.

Note: GovHack has informed me they are still adding videos for teams with network issues, so the numbers in this post and my spreadsheet will underreport. I'll update it once final numbers are confirmed.

National prizes will be awarded in a red carpet event in Brisbane on 10 August. I'll be attending courtesy of GovHack, to live tweet and blog the event.

All the projects are visible at the GovHack website, linking to project pages. There's links to home pages and videos for projects eligible for the national awards.

I've analysed all of the GovHack projects and teams based on GovHack's site and you can view this analysis at: docs.google.com/spreadsheets/d/18H4gWSuVLb5Mjt84YdymeXSlSaAxjY78lX5T90i6RmQ

Here's a few quick charts from my GovHack stats (mouseover for details):


Finally, below is the finishing video for GovHack 2014.



I hope I see you at the GovHack Red Carpet Awards!

Read full post...

Friday, July 11, 2014

GovHack is underway - but what is it?

I'm participating in GovHack this year, spending my weekend working with a team to build a cool tool from open government data.

If you're a bit unclear on what a Hack is, the five minute segment below from ABS News 24, featuring GovHack national coordinator Pia Waugh should give you a better idea.



If you want to learn more about GovHack, here's the opening video - also featuring Pia Waugh, as well as the Minister for Communication Malcolm Turnbull.

Read full post...

Thursday, July 10, 2014

Minister Turnbull launches brilliant #opendata National Map of Australia - plugs GovHack 2014

Yesterday Minister Turnbull announced the launch of the NationalMap beta - a project jointly developed by the Department of Communications and NICTA to create a single authoritative geographic view of Australia from an open data perspective.

The Minister said the Map was "part of the Government’s commitment to increasing the number of publicly available datasets."

The NationalMap beta, available at nationalmap.nicta.com.au, aggregates datasets from Geoscience Australia, the Department of Meteorology, the Department of Communication, Australian Bureau of Statistics and a host of other agencies via data.gov.au.

Ranging from topographic features to transportation networks and infrastructure to statistical boundaries (including the ABS's new mesh blocks), all of the datasets are available as open data and can be individually downloaded from within the map interface using their respective 'info' links.

There's also a link to 'Add data' to the Map, which I presume allows a user to upload custom data sets to display, although I could not get this to work.

The NationalMap is built on an open source stack of technologies, including Geoserver, Cesium and Leaflet. NICTA are contributing to these projects where relevant to help improve their capabilities.

In my view the site looks great.

I like the fisheye lens 3D approach used by default, and this can be easily switched to 2D if people prefer. The navigational controls are standard for online maps and the interface is simple to use, though a lack of visible labels means users have to mouseover each icon individually to find out what they do.

The NationalMap did load and update slowly when I used it, particularly as more layers of data were added. Given this is a beta, and presumably hosted on a lower end server with limited bandwidth, this was neither surprising nor a major problem.

Overall I think the NationalMap beta is a great step forward for Australia and provides a rich source of reusable open data for GovHack this weekend.

Hopefully this is only a taste of the projects the Coalition government is championing within government as there's tremendous value to be found in open data, if agencies receive a clear mandate to release it for reuse.

There are so many opportunities right now to use Gov 2.0 approaches to empower businesses and communities to more proactively engage in government policy development, service delivery and self-management. If the government can realise these with a clear and mandated agenda, Australia will be in a strong economic position for years to come.

Read full post...

Wednesday, July 09, 2014

Having a dinosaur in your corner really helps with public sector innovation

It's quite common for those of us on the pointy end of Government 2.0, innovation, agile and open source/open data and similar 'progressive' thinking to refer to people who seem reluctant and risk-averse as 'dinosaurs'.

The terminology crosses the government/corporate divide - indeed I'm hearing it now more often in reference to senior management in large Australian companies than in government agencies.

Sometimes it's used as a term of affection, sometimes in derision - but there's always the implication that the designated 'dinosaur' is out-of-touch, missing opportunities and holding back their organisation.

However if you take a step back and think about it a little more, many supposed 'dinosaurs' are actually quite progressive in their thinking and activities. They may simply have a different role in the workplace, with different workplace priorities and key performance indicators.

Or they may simply be a product of different life experiences - grown up in an age when media was less complex and the internet was limited to academic institutions.

Sometimes all the 'dinosaurs' need to transform their thinking is a clear business case couched in terms they understand, or a life experience which makes them realise the world has changed.

Indeed I can think of one extremely senior Australian public servant who transformed their thinking after observing how their children used Facebook to organise a successful family gathering - realising social media wasn't just about sharing lunch images, but had real value as a tool for marshalling support and spreading information.

Other 'dinosaurs', however, can be destructive - holding back their organisations to the point where they miss large opportunities or damage organisational reputation and brand. I've seen this numerous times - to the extent where Ministers have been harmed by the decisions of senior public servants.

There's also a group of supposed 'dinosaurs' that aren't dinosaurs at all. They're impersonating dinosaurs for role or camouflage reasons - people who prefer to influence from inside a group, rather than from the outside.

So how can progressive thinkers ('mammals'?) help to tell which dinosaurs are which? How can they help dinosaurs evolve?

One particular strategy that helps is to have a dinosaur on your side - preferably a large one with substantial presence and influence.

If you can identify someone who is simply wearing a dinosaur suit for workplace purposes, rather than being a true dyed-in-the-scale dinosaur, you've got a significant opportunity to enlist that person to begin influencing from within. Provided that person is seen as another dinosaur (albeit a slightly unusual one), they can often significantly influence an organisation's agenda as a champion for innovation, open data, or whatever the progressive workplace cause might be.

Alternatively if you can find a dinosaur who is purely driven by their role or KPIs, identify how to match your business case for moving forward with their workplace goals. if you can align a progressive approach with their priorities you will find they quickly shift their position - even take ownership of the idea - as they can see the benefit in personal and professional terms.

However if you find that all your dinosaurs are true dinosaurs - unable and unwilling to change, even when the business case is strong - consider your options.

You could bring in supposed dinosaurs from other organisations that they trust and respect, to show them the error of their ways.

You could wait for an extinction event, their retirement, replacement or, unfortunately, a serious event which proves their decisions were wrong.

Or you can seek a new habitat - changing roles or workplaces to find one where there is more room for change.

Just always keep in mind that not all dinosaurs are really dinosaurs (just as not everyone claiming to be a progressive workplace thinker is one), indeed many think themselves quite progressive.

And keep in mind that having your own dinosaur in the corner is far more effective than simply throwing stones.

Read full post...

Tuesday, July 08, 2014

The importance for government of respecting open source and open data copyrights

An interesting situation has arisen in Italy, with the country's Agenzia delle Entrate, the Italian revenue service and taxation authority, accused of copying OpenStreetMap without respecting the site's copyright license.

As documented on the Open Street Maps discussion list, Italy's OpenStreetMap community discovered a little over three months ago that the maps used by the Agenzia delle Entrate in the website of the Italian Observatory of the Estate Market (housing market site) closely resembled those from OpenStreetMap.

In fact, they were able to establish that the Agenzia delle Entrate had copied data from OpenStreetMaps, then superimposed other data on top.

Now given OpenStreetMaps is an open source project, crowdsourcing the streetmaps of the world, that shouldn't normally be a problem.

OpenStreetMaps' data is freely available to copy and reuse - that's the entire point of it.

However there was one factor that the Agenzia delle Entrate had ignored. That the copyright license to freely reuse OpenStreetMap data came with one condition - to credit the source.

Using a Creative Commons by Attribution license, which is also the default copyright for Australian Government information, OpenStreetMaps required only one thing of organisations and individuals reusing their data - to provide an attribution back to the source.

This the Agenzia delle Entrate had failed to do.

OK - this isn't a big issue, and the folk in Italy's OpenStreetMap community weren't that worried to start with. They simply emailed the agency to ask it to correct this omission.

No reply.

Three months later - with no formal response from the agency, and no rectification of the copyright on the site, the OpenStreetMap folk stepped up their criticism.

They created a website where Italians and others can view and compare OpenStreetMap with the Agenzia delle Entrate's site to see how the Italian government agency has violated copyright for themselves.

You can view the website here: http://agenziauscite.openstreetmap.it/

It's in Italian (naturally), so if you don't read the language an online translation tool can help, but isn't required to compare the maps.

I suggest that visitors use the search tool in the left-hand map to find 'Milan', which is the city recommended for comparison purposes. Note that the agency took its copy of OpenStreetMap a few months ago, so is not as up-to-date as OpenStreetMap itself.


The situation has grown from a simple omission into an active campaign, not only because the government agency ignored the community concerned, but also because that community now feels that if the government is prepared to ignore copyright requirements so blatantly, how is any other copyright in Italy safe.

Essentially if a government agency won't do the right thing when reusing intellectual property, why should businesses or individuals trust them - or do the right thing themselves.

It's something that every government agency should ponder.


Read full post...

Friday, July 04, 2014

What happens to governments when the trust disappears?

It's difficult for governments to remain effective when the support of citizens evaporates. History is littered with failed states, civil wars and insurrections resulting from society's loss of trust in their rulers and governance systems.

In authoritarian states this support is often built on fear, coercion and control, which can prove to be very fragile when citizens lose their fear of a government, as Libya, Tunisia, Egypt and Syria have most recently demonstrated.

Whereas in democratic states support is given willingly based on a covenant that governments will do the best for all in society and citizens will follow laws on the basis that they are applied equally. When these covenants break down, they tends to do so more gradually and over a longer period of time, with a gradual loss of support as governments become more selective in who they govern for and institutions are eroded through partisan appointments, corruption and budget cuts.

However the end result can be similar, as Thailand, Zimbabwe, Somalia and Fiji have demonstrated, with civil war, authoritarian takeovers or societies completely breaking down.

It can take much time for societies to recover from these breakdowns, with economic loss, insecurity and often deaths before a state regains its feet.

Right now we appear to be living in a time of low trust in governments and many institutions, including public services around the world.

Globally the Edelman Trust barometer for 2014 recorded a 4% decline in overall trust in government from 2013 to 2014 (refer slide 23 in the deck) - with particular falls in the US, France and Hong Kong.

This has also been documented in US studies, where trust in the Senate is at only 7%, at 29% for their House of Representatives, and trust in the President's office in decline.

Australia saw an increase year-on-year in the Edelman Trust Barometer, however this wasn't evident in the latest Essential Report (1 July), which roughly annually assesses people's views of government and different institutions.

With an error of +/- 3% at a 95% confidence interval, the survey suggested that 31% of citizens trusted the Commonwealth Public Service, 25% trusted the Federal Parliament and only 12% trusted political parties.

Local councils did marginally better than any of the above groups at 33% trust. State governments were more trusted again at 39% (Queensland) up to 54% (NSW).

Also according to Essential, only 31% of people trusted the government to responsibly use any information collected and held about them.

Now these are numbers in isolation, what's more interesting is a trend over time.

Unfortunately Essential has only been polling on these topics for a few years - with some institutions (such as local councils) only starting last year, so it's hard to form an impression as to whether trust is increasing or decreasing in the longer-term, though many have seen short term declines in the last year.

Of particular note is the decline in trust in the Commonwealth Public Service, which has plummeted from 49% in 2011 to only 31% in 2014.

This is a 50% decline in only four years and should worry all senior public servants.

A lack of trust can lead to difficulties in sourcing information for policy creation, in getting the right people to contribute to shaping policies and can raise difficulties in implementing programs as communities ignore or distrust communications from the government.

Adjunct to this is the low ongoing trust in political parties, which has probably contributed to the high number of independents and minor parties elected in the last two federal elections. In fact a quarter of the seats in the current Senate are held by non-major parties, the highest proportion in our history.

This also contributes to difficulties in passing laws (as we're seeing already) and can lead to parliamentary paralysis. While the government of the day does have the ability to request a double dissolution election with the right trigger (which is already in place), its unlikely a government will do this unless they believe they can improve their position, which isn't the case right now according to opinion polls, and based on the trend appears to be getting less likely by the week.

Total trust2014201320122011
The High Court57%74%60%72%
The ABC54%70%54%46%
The Reserve Bank52%64%49%67%
Your local council31%38%
The Commonwealth Public Service31%35%30%49%
Federal Parliament25%31%22%55%
State Parliament24%28%
Political parties13%12%12%

At the same time we've seen a change in how Australians perceive democracy as a form of governance, with New Matilda recently covering Lowy research which suggests that, "Democracy No Longer On The Nation's Radar".

The research has been conducted for ten years and has shown a growing disillusionment with democracy in Australia. As reported by New Matilda,
"only 60 per cent of the Australians Lowy surveyed believed that “Democracy is preferable to any other kind of government”. By contrast, 24 per cent of Australians held the opinion that “In some circumstances, a non-democratic government can be preferable.” Another 13 per cent felt that “For someone like me, it doesn’t matter what kind of government we have”

For Generation Y respondents the figures were even more striking, with only 42% of respondents preferring democracy.

While these levels of trust in our system, politicians and public service are not yet critical, they are definitely concerning and need to be understood, monitored and causes addressed appropriately.

That leads to the next point - the causes of low trust in Australia and around the world.

I've blogged previously about how the internet is a contributing factor to this trust issue. People are able to rapidly share information, expose falsehoods and politically and socially organise more rapidly than ever before, and this has a material impact on how nations conduct their affairs.

I don't think many governments have yet internalised the impact of the internet on their political and governance behaviour, and this is costing them respect, lost time and effort.

The push for open government, which has stalled in Australian political circles (even going backwards in some areas in the last year), is a reaction to governments seeking to control information flows, even online, and generally failing due to failures to adjust their culture, regulations and behaviours to operate effectively in a digital society.

More openness is good for governments - provided they have thick skins, are prepared to accept criticism and are equal to the task of transforming both political and governance institutions into more engaging and effective communicators.

Without this transformation, governments are increasingly scoring own goals - damaging their political and governance credibility through secretive decision-making processes and decisions that are either or both poorly conceived and poorly communicated.

The 2014 Budget is a case in point - the government followed an 'old school' approach to leaking and preparing the public and then did the normal TV, radio and in-person select appearances to 'sell' it to citizens. However there was no real attempt to engage citizens online, through the social channels where the public were forming and hardening their views even before Ministerial media releases were published in newsprint.

Unfortunately we're still seeing the same behaviour repeated again and again - with government Ministers and agencies attempting to shutdown conversations they don't want by refusing to speak, an old-school approach which is based around government being the main source of information. Now, however, the community is willing to fill the gaps, so these conversations simply don't end - leaving government looking increasingly silly and ineffectual as the only silent group in the room.

This behaviour will contribute to further erosion of trust in institutions, and government agencies who do it to protect their Ministers are having the exact opposite effect - harming Australia's governance system in ways that may prove, over time, to be irreparable.

Governments are also scoring own goals through some of their decisions, which are only damaging the political estate further.

With all of this currently going on I am increasingly worried about the damage being done to Australian democracy and wonder whether it will be reversed before we see irreversal damage or the demise of one, or both, of our major political parties.

Through all of this I hope that the integrity and performance of the public service, recently rated one of the best in the world, is sustained, so that Australia will have the governance structures, expertise and dedication to rebuild trust in the systems we rely on to remain one of the happiest, most secure and wealthiest nations on earth.

Read full post...

Tuesday, July 01, 2014

Guest post: Unlocking Budget Data in Australia: the BudgetAus Collaboration

Republished with permission from the International Budget Partnership blog

This post was written by Rosie Williams of InfoAus.

Unlocking Budget Data in Australia: the BudgetAus Collaboration

Budget transparency in Australia has recently taken a big step forward with the first ever release of federal budget data in machine readable format. Prior to this year, budget data in Australia had been locked away in PDF and Word documents. While these publications met the broad guidelines for reporting government spending to the public, analysis of government spending remained a difficult and time consuming process.

Providing information is one thing, making it usable is yet another.

Unlocking the data

As a novice programmer with a degree in sociology and background in activism, I decided to address this problem by creating a web tool that would allow users to explore the entire federal budget. The website — BudgetAus — works in much the same way as a search engine: users can search for their areas of interest to see how much money the government is spending, regardless of the agency or portfolio in which the spending occurs.

The original site was built from budget data that I manually copied and pasted from the existing PDF’s published by the government. The following year we tried to program scripts to scrape the data, but this proved too time consuming. The complexity of the data contained within the documents, and the fact that the documents presented information in different ways and were not broken down to the same level, proved challenging.

Behind the scenes, people had been working within government to release budget data in machine readable formats (as data files). However, they faced the same set of challenges – inconsistencies in the way the data was organized by different agencies made them unsuitable for use by programmers.
A budget visualization created using BudgetAus data. From Arthur Street’s Australian Budget Explorer.

Building a network

Having established my interest in budget transparency over the past year or so, I found a small network of people with a strong interest in what I was attempting. This network includes experts who work on the federal budget, veteran journalists, and professional programmers.

With the first release of machine-readable budget data imminent, we made a big push to have this data reformatted and made consistent with the requirements of BudgetAus and similar projects. This was no easy task, with a team working overnight with the Excel tables contributed by each of 180 agencies to produce line item data in a suitable format.

Going public

Getting the data is only one requirement of a successful budget transparency project. Engaging the wider public with the purpose of having access to the data is also crucial. I used a budget night event to find collaborators willing to put the budget data to use. With the help of some prominent independent journalists, Wendy Bacon and Margo Kingston, the BudgetAus collaboration, as it has become known, spent budget night using social media to find out what sort of budget questions people wanted answered.

Wendy set up a Question Bank on GitHub – an online, open source collaboration tool. This seems to be functioning quite well for public discussion of budget transparency questions. Some developers in our network set up a data visualization repository to support this and future efforts by coders and citizen bloggers to produce meaningful graphs and visualizations based on open data.

Everyone played complimentary roles, from the budget experts who providedbackground on the nitty-gritty of budget questions, to the media and our coders. Collaborators seemed to fall quite naturally into their respective functions.

Where to from here?

Based on this years’ experience of working with BudgetAus, the government is now designing a standard way for agencies to report spending.

While BudgetAus and its collaborators have helped to shine a light on the important issue of data consistency, there is much work that remains to be done. Answering questions such as how spending promises (estimates) differ from actual spending, and how different political parties make changes to public spending, will require retrospective data that is so far not available. To continue to build on the success of the project will require funding the formalization of a group working on these issues.

In the end it took leaders within government, the respective agencies, citizen journalists, citizen hackers, and the general public to begin a functioning budget transparency project. I hope that this is just a beginning.

Read full post...

Thursday, June 19, 2014

The economic value of open data to Australia

This morning I attended the breakfast launch of the Open for Business: How Open Data Can Help Achieve the G20 Growth Target report.

The report was written by Nicholas Gruen (former chair of the Gov 2.0 Taskforce) and his team from Lateral Economics, with support from Victoria University and commissioned by the Omidyar Network (the not-for-profit organisation established by eBay's founder).

It makes a compelling economic case for open data, estimating aggregate direct and indirect value for Australia was in excess of $15 billion per year. This was based on estimating the economic value of open data just across the G20's seven priority areas, which I've provided below as a table.

G20 priority area
open data value 
per annum to Australia
Anti-corruption
$1.5 billion
Employment
$3.4 billion
Energy
$1.7 billion
Fiscal and Monetary policy
$3.6 billion
Infrastructure
$3.6 billion
Trade
$1.6 billion

Relative progress on open government data areas
Source: http://theodi.github.io/open-data-barometer-viz
The report suggested that Australia was still doing very well in the open data space, ranked 3rd amongst G20 nations (7th or 8th overall globally) - but that there was still much room for improvement and learning from other countries.

During the presentation Martin Tisne from the Omidyar Network said that Mexico and India had demonstrated leadership in opening up education data, while South Africa had taken great steps with open budgetary data - making the point that different nations have excelled in different aspects of openness, but few had demonstrated consistent strength across all aspects of open data.

The report included a great deal of detail on different areas in which governments could achieve economic value through open data - and also highlighted that the cost of realising these benefits could be up to a third of the value received, giving a clear signal of the need for government to invest in this area, not simply allow it to thrive or die on its own with no support.

Both Nicholas Gruen and Tony Shepherd, head of the Commission of Audit, highlighted the need for senior Ministerial leadership, and Gruen noted that no Australian Prime Minister had ever been a passionate supporter of open data, to Australia's detriment where the US and UK had significant political as well as public service leadership for openness.

The presentation also highlighted some of the current pitfalls for entrepreneurs seeking to take advantage of open data while there was no consistent commitment to its release.

Gruen illustrated this point by discussing APSjobs.info, a site created at a past GovHack, that mashes up data on public servant movements from APSJobs.gov.au. He said there was clear added value realised via APSJobs.info, which could be a useful reference tool for recruiters and agencies seeking to identify the best talent.

The report states that:
APSJobs.info's business model was predicated on its development of successful technical methods to 'scrape' the data from pseudo-print PDFs. However frequent changes to the formatting and layout of these files meant continuous re-development of the PDF conversion software to continue to access and add value to the data. The skills required to perform such work (data-mining and text-analysis) are in great demand, and the cost of frequently using such resources exceeded the benefits to Pivotal Analytics.
APSJobs.Info is now defunct - a casualty of government inconsistency.

The Open for Business: How Open Data Can Help Achieve the G20 Growth Target report is highly material in establishing the value of open data to governments and the steps they need to take to realise the economic value that could result from greater release of reusable data.

Hopefully Australian governments will continue to build their commitments to open data and we'll see some of this value filtering back into our economic.


Read full post...

Tuesday, June 17, 2014

Only four weeks to GovHack - register now!

GovHack, the largest open data competition in Australia, is only four weeks away.

With over $70,000 in national prizes, and local prizes in each of the 11 locations around the country, there's not much time left to join the already over 1,000 registered participants to mash-up government data.

Register now at www.govhack.org/register-2014/


Read full post...

Wednesday, June 04, 2014

For a truly open parliament, look to the UK

The UK Government has just released the alpha version of data.parliament.uk - - a site designed to host open data on the UK Parliament and its proceedings.

(An Alpha for those who don't understand the term is a first release of a software product that is usually tested only by the developers).

The alpha release of www.data.parliament.uk
The site represents a new frontier for parliaments - making information on the discussions and deliberations of politicians far more actively available in ways that it can be reused to inform the public.

The site is sparse at the moment - only a few datasets on parliamentary questions, on how MPs have voted (something we don't publish in Australia despite it being common data available in North America and Europe) and briefing papers.

It will be interesting to see how it grows in form, function and data and whether it becomes a truly useful source for citizens.

Read full post...

Wednesday, May 28, 2014

How important really is open government to Australians?

The United Nations is currently running a very interesting global consultation asking people about the six issues that matter most to them.

Named myWorld2015 (vote.myworld2015.org), the consultation has attracted over 2.1 million responses from around the world.

Of these, there have been 14,896 responses from Australia (viewable through the data page) - and it is very interesting to see which issues the Australian respondents have put as the most important to them.

The 'usual suspects' are at the top of the list, a good education, access to clean water and sanitation, protecting forests, rivers and oceans and affordable and nutritious food.

Here's where it gets interesting.

The issue that comes fifth for Australians is "an honest and responsive government".

This issue rises to 2nd when looking at male Australian responses, and falls to 6th position when looking at female.

It is the most important issue for Australians aged over 61, ranked third for Australians aged 41-60, 5th for those aged 16-45 and 6th for those aged 15 and under.

Now I should note there's 16 issues to choose from and the only other issue directly relating to government is "political freedoms".

This ranks much lower - 11th for all Australians.



So what can be drawn from this data?

Australians do feel that "honest and responsive government" is a relatively important issue for them - less important than the environment or education, but more important than better healthcare, protection from discrimination or action on climate change.

Wrapped up in this is the notion that governments act in a truthful and upfront way, that they are accountable, transparent and, to some degree at least, open.

So if any Minister or senior public servant questions the value of open government, point them to MyWorld2015 and the views of nearly 15,000 Australians.

It might help them change their mind.

Read full post...

Monday, May 12, 2014

Keep an eye out for Australia's open budget

We've now suffered through most of the fun and games of budget leaking season this year, with the 2014-15 Australian Government budget now in its final 'straight'.

There were a variety of balloons floated, claims and counterclaims touted, promises apparently broken (or not, depending on who you listen to) and all the usual suspects wheeling out to give us their authoritarian views on how budget changes would break or make Australia.

This year it has even been capped off by images of the Finance Minister and Treasurer enjoying a relaxing cigar as their departmental teams work frantically behind the scenes to get the final planks of the budget in place.

In other words, it's been largely business as usual for the Australian Government budget process - following the same pattern that's been followed for thirty or more years.

There have, of course, been some changes.

The communications channels used to inform people about the budget have shifted slightly (though not as much as they could), and the community has become far more visible in its budget consultations through the widespread adoption of online social channels - though politicians and traditional media have remain largely one-way broadcasters, rather than embracing the opportunity to engage.

Some government agencies have also adapted their strategies for informing the public - using social media to broadcast their budget statements and to engage online in so far as to correct misunderstandings and address myths and beliefs which are not supported by budget papers.

In the last few years Australia even stepped to the world leading position of releasing much of the budget papers under creative commons licensing (now the standard copyright for the Australian Government) - with this stimulating the creation of new ways to view the budget, such as The OpenBudget and BudgetAus.

These services are still relatively new and have suffered from the inaccessibility of the PDF documents used to publish the reusable budget data - meaning the creators of these tools had to scrape PDFs for data, manually type or check every figure, to get a realistic budget view.


However this year, in another world first, the Australian Government budget is set to be largely released in spreadsheet formats.

A team of public servants in Finance and Treasury is aggregating all the budget numbers from a range of agencies and releasing it in an aggregated way that is easy for others to reuse.

This is a huge step forward and opens the gate to a range of community and media visualisations of the budget at a far lower commitment of effort than was possible in previous years.

So keep an eye out in the coming days for some of the budget projects that are created using this open data.

I'll try to list them in this blog in the days following the budget's release.

Read full post...

Sunday, April 13, 2014

GovHack registration opens - with ten locations across Australia for 2014

GovHack 2014 has just opened for registration with 10 locations across Australia, being:

  • Brisbane GovHack
  • Canberra GovHack
  • GovHack FNQ (Cairns)
  • Gold Coast GovHack
  • GovHack Tasmania
  • Melbourne GovHack
  • Perth GovHack
  • Sydney GovHack
  • Unleashed Adelaide
  • Unleashed Mount Gambier 

While competition details are not yet available, the official 2014 datasets will be put online over the next two months.

There will be a data event a month before GovHack where data custodians can present about the official datasets and allowing Govhack registrants to ask questions about the quality, formatting and other information about the data.

There will also be a red carpet event a month after GovHack to celebrate the winners.

To register visit govhack.org/register-2014

For more information visit: govhack.org/2014/04/11/3-months-till-govhack-2014/

Read full post...

Friday, March 21, 2014

Government stakeholders and citizens see different priorities for open data release

Socrata has released an interesting benchmark study on open government data, which looks at the state of open data from the perspectives of citizens, developers and government.

It is interesting to compare which data government stakeholders consider important to publish, compared to what citizens feel is important.

Looking at Very Important from the tables (below) it is pretty clear that government puts a higher priority on data about themselves - for example the location of government services. This tends to be easier data to release as governments know where their shopfronts are and want citizens to find them.

However from a citizen perspective there's a priority on data that supports communities and increases transparency - public safety, financial data and accountability ranking 1st to 3rd for 'Very Important' (compared to government stakeholders who rated them 3rd, 8th and 7th). Government service locations is still relatively important but only 5th on the list for 'Very Important' and even lower at 8th when 'Moderately Important' is considered as well).

Census data is perceived as far more valuable by government stakeholders (6th) than the community (13th), possibly because governments consider the business value and individual citizens only rarely directly need access to broad demographics (such as when buying a house).

Education data is also in an interesting position. It is 4th for citizens but only 10th for government stakeholders on 'Very Important' - however when 'Moderately Important' is added, it shoots up to 2nd for citizens and for government to 8th place.

This could be reflected in how there's been quite a bit of political opposition to myschool.gov.au, but plenty of community buy-in. Someone's getting the sentiment wrong here, and I don't think it is parents.


It would be very interesting to see governments hold this type of study in Australia - looking at government stakeholders, citizens, businesses and civic hackers (maybe media as well), to understand the differences in expectations and how different data is valued.

Unfortunately we may be a little immature culturally to ask this as yet, open data has not had a significant impact on most people's lives and hasn't consistently been championed at a political level or put 'on the agenda' in more than a niche way.

It is clearly important for people inside and outside government to appreciate that government stakeholders may have very different views to others in the community on what open data is a priority to release and governments take appropriate steps to engage and consult with other groups in the community on an ongoing basis to understand the differences.




And a tip for politicians seeking to get elected or a Ministerial slot - there's clear support in this survey from citizens for politicians who advocate for open government and walk the walk. In fact three out of four citizens said they'd be more likely to vote for a politician who was an open government champion.


Citizens also see open data as worth investing public money in. I'm sure our Treasurer will consider this in his upcoming budget statement - which will be released under Creative Commons and as reusable data of course!

Read full post...

Thursday, February 13, 2014

What's beyond transparency? Find out at the next Code for Australia event in Melbourne

As part of the CodeAcross2014 series of global events (over 44 events in 9 countries), Code for Australia is holding a free event on Friday 21 March from 5:30pm in Melbourne.

Featuring four guest speakers, the event will approach the "Beyond Transparency" theme by discussing how citizens, civil servants and entrepreneurs can move beyond open data to come together and build new ways of solving problems.

For more information, or to register, visit canbook.me/codeforaustralia

Read full post...

Bookmark and Share