Showing posts with label open data. Show all posts
Showing posts with label open data. Show all posts

Monday, November 30, 2015

Register now for an OGP Australia information session

The Department of Prime Minister and Cabinet have just announced a series of information sessions regarding the Open Government Partnership and the process by which the Australian government is seeking to involve the community and civil organisations in the development of our first National Action Plan by the end of June 2016.

For information on these sessions, which will occur in the week of 14-18 December in Brisbane, Sydney, Canberra and Melbourne, visit the OGP Australia blog at: ogpau.govspace.gov.au/register-to-attend-an-ogp-australia-information-session/

Read full post...

Wednesday, November 25, 2015

Using open data for insights into Australian-registered charities

Rosie Williams of OpenAus recently released her latest open data project, Open Charities, to provide insight into the financials of Australian charities.

The service integrates the available open data from 53,000 registered Australian charities in a way never done before, allowing fast and simple analysis of charities by location, electorate and issue.

To fund this work on an ongoing basis Rosie has also introduced a subscriber-only feature at $50 per year which provides access to information on all of the government grants and tenders won by each charity - connecting together several different open datasets.

This information is useful not only for people considering donating to different Australian charities, but also for charities seeking to research their sector and those thinking about creating new charities.

It's important to note that all of the value unlocked by Open Charities and similar open sites would not be available if not for the hard work by volunteers such as Rosie.

There's still too few of these volunteers, meaning that there's potentially immense value left untapped across the tens of thousands of open datasets now released by Australian Government.

This means there's still enormous opportunities to identify and realise value for startups and social enterprises seeking new ways to repurpose data into useful knowledge.

If you've ever had an interest in finding solutions to social and economic problems, why not take a look at Rosie's work and think about the value you could add.

Read full post...

Tuesday, November 10, 2015

Guest post: Moving things forward – addressing the information gaps

This is a guest post written by Rosie Williams, a leading Australian Open Data Developer and Citizen Journalist, who created and manages infoAus.net and writes for NoFibs.com.au. It's republished from OpenAus with her permission.

The Power to Persuade blog fosters new ways to collaborate across sectors for better social policy. Power to Persuade recently published a post of mine on open data in which I argued for the role of transparency in addressing social policy questions.
I recounted a recent attempt to discover the number of homeless shelters across Australia, only to be met with a quote for over $1,000 in consideration of it not being previously published and due to difficulties in extracting the information from the system. The most interesting thing bar the cost of the service is that the reason I was forced to seek this data directly from the AIHW in the first place was exactly because I had not found it in any of the reports published by government or community sector.
As a financial and political transparency activist I have been looking into how decisions regarding the funding of housing/homeless services flow through the policy process in order to understand why such a substantial unmet need for specialist homeless services is tolerated. Australian Institute of Health & Welfare figures show that nearly 60% of people making a request for accommodation on any given day are turned away. I want to understand what process leads to this outcome.
I have also heard privately from service providers, the very organisations required to report their own data to government that they do not have access to key metrics.
Open data is a fairly new concept for Australia.Open data is data that is made available free for re-use for commercial or non-commercial purposes. The government is yet to fulfil it’s obligations to the Open Government Partnership although there are rumours this is finally about to change. The OGP requires the Australian government to submit a National Action Plan detailing extensive consultation in the areas of fiscal transparency, access to information, income and asset disclosure, and citizen engagement, all areas which affect our power to make society answerable to our needs and the needs of the vulnerable.
The government has been opening data for the last few years but there are few instances of that data being re-used. My own projects in financial and political transparency are an exception. The Commonwealth government is now implementing new grants reporting requirements to provide consistency in reporting grant recipients and locations for every relevant agency. This data set is not yet complete or available in one spot but what is available is searchable at OpenAus.
It is only when data is put to use for a specific purpose that it becomes obvious where data sets are missing or data quality needs work. One of the biggest challenges to open data is where the need for data crosses jurisdictional boundaries as it does with many questions of social policy. Issues such as domestic violence or homelessness require data not just from federal services but also state agencies. With every state potentially doing it’s own thing with regard to data collection and publication, trying to find or use data covering multiple agencies or jurisdictions is a major hurdle in any attempt to make use of open data in Australia for improved transparency, policy or practice.
To address these issues, there needs to be engagement between jurisdictions and also between sectors. Government agencies responsible for gathering and publishing data need to engage with both end users of that data and contributors to that data in order to improve quality and foster awareness of the existence and uses for that data.
To provide a pathway forward I have set up a Slack community open to practitioners in social and data science, researchers and government. The goals of this community are as follows:
Community Goals
  • provide venue to engage end users of data, organisations contributing data to government and data custodians to better address social issues
  • lobby for improved data and transparency
  • provide answers on specific data questions eg where can I find information on x?
  • run events /produce materials in support of these goals
Community Participants
This community is for practitioners, researchers, policy makers and anyone who can provide assistance to these groups in terms of answering questions about where data can be found and what can be done with it.
My various networks cross the boundaries of journalism, technology, data science and politics. Providing a bridge between these groups paves the way for people with diverse skills and information to come together to help professional communities realise their aims. If you would like access to this community please email me from your work account for an invitation.
Slack is a platform that allows for chat between teams and private messaging and integrates with a host of other services. It is easy to join and use, taking the place of both email and forums for purposes of discussion and planning.
How to Participate
Email Rosie at admin @ openaus.net.au from your work email to enable me to send you the invitation.

Read full post...

Friday, November 06, 2015

Economic value should be a benefit, but not the reason for open data

I've been reading various views and reflecting on the DataStart competition.

There's a shift I've been observing in how some people in government talk about open data that is making me quite uncomfortable.

I like that the commercial world is finally taking note of the value of open data and the prospect to build businesses using it.

I like that corporations are beginning to adopt some of the techniques of openness pioneered in the public sector and use them to build usability, value and (hopefully) profits.

I like that the government is taking a firm position on innovation and has finally begun to realise that Australia needs to have a strong and effective digital strategy with senior leadership to remain a relevant first world nation in a world increasingly built on data.

However there's one thing that does concern me.

There's been a progressive shift in language from certain government levels that suggests that the primary reason for releasing public sector information in open, reusable formats is for economic benefit.

Other benefits, such as the ability to hold government to account, improve policy development and assessment and the social benefits of open data in areas such as health, emergency management, education and employment, have been downplayed or ignored.

We've seen hackathons run in Australia on government data for six years now, with over 1,500 web services and apps developed by teams.

The vast majority of these apps and sites focused on social, policy or accountability benefits - very few were developed specifically with economic goals, even in competition categories focused on entrepreneurship.

These competitions have showcased a wide variety of benefits for open data, and agencies have, for the most part, heard this. However the language from the top of government is all about commercialisation and creating businesses from data, the other benefits ignored.

Exemplifying this trend, the DataStart competition doesn't specifically exclude non-commercial entrants, however there's no cash prize at the end for any such winner, the $200,000 investment package prize is restricted to those entrants who squeeze out a commercially viable business (as defined by RightClick Capital and Polleniser).

Other entrants can get, at best, some support from the Department and maybe a five-day start-up bootcamp in Sydney.

The message being sent is clear - non-commercial ideas for open data need not apply.

Essentially the DataStart competition puts the economic benefit of open data ahead of any other benefit - and again this isn't a bad thing. There's reason to support the commercial value of open data, just as there's reason to support the social and policy value of this data.

What is concerning is that the message from government is shifting towards making this economic benefit the main reason for opening up, or improving the quality, of government data.

This could lead into a situation where the data prioritised for collection, cleaning and open release is the data with commercial value, over data that has accountability or social value to Australia.

It attaches a price signal to open data - it must be commercially valuable, or it's not valued.

This flies against the spirit and full value of open government data.

I hope that we do not see governments making commercial decisions on whether to open up data based on the number and perceived economic value of the start-ups they foster.

Government has a bigger role in this, it should focus on public value - balancing how this is achieved, via commercial value, social value or the accountability necessary for a democracy.

So yay for DataStart, but it would be unfortunate if economic value became the reason, rather than one of the benefits, of opening up Australian government data to the public.

Read full post...

Wednesday, November 04, 2015

Government launches DataStart fund to foster open data startups, but which problem is it trying to solve?

A few days ago the Australian government announced the launch of the DataStart fund, to be managed by Polleniser and with the involvement of RightClick Capital, which aims to foster open data driven startups with commercial ideas.

The pilot nine month process will see 20 startups pitch to a board of government and industry judges, with a winner to receive $200,000 in support to get their business off the ground.

This is an area that people in the open data scene have been discussing for a few years now, on the back of the low rate of initiatives coming out of hack events in Australia that go on to some form of commercial existence, let alone financial success.

Initiatives in this area are always good, however I worry about what problem this is designed to solve.

Is it the government's problem that startups aren't using lots of open data to facilitate their businesses, or is it an actual problem where startup businesses with viable commercial ideas involving open data cannot locate appropriate funding options?

I wonder whether the first step should be to ensure that the open data being released by government is both the right data for companies to use to deliver on commercial needs and is being released to a commercial standard.

Frankly while I totally support the increasingly open release of data there's very little that I see being released at a commercially ready level and granularity. Weather and public transport data at state level being a few of the exceptions.

There will be startup opportunists who bake a little open data into their startups to access this fund. There also may (I hope) be a few hack participants able to take their open data fuelled ideas forward in a more commercial way.

I am sure the government will happily support both types through this initiative in the hope this creates some momentum - and I truly hope it does.

However unless these start-ups have solid ideas with strong business cases and could essentially be profitable even if they had to collect the data themselves or pay for it, by and large government is still an unreliable source of timely and relevant open data.

Right now data.gov.au has a shoestring budget and no funds have ever been allocated by an Australian government to support agencies to develop and implement effective open data release processes.

While the team at data.gov.au has done a fantastic job with very little, and the ball is now truly rolling in agencies, which are increasingly interested in releasing datasets for public reuse, the lack of foundational funding means that the frequency of data collection, data quality and data release tends to be highly variable across government open datasets.

Right now I would prefer to see funds reinvested into ensuring government provides reliable data rather than on fostering businesses build on data sources that are insufficiently robust or could disappear overnight with a Ministerial or agency-level decision.

I know both the government and Polleniser are authentically enthusiastic and supportive of fostering open data driven startups. I hope that in coming weeks we see budgets allocated to help agencies provide reliable and robust open data sets, not just to fostering companies built on an unreliable base.

For now, register for a DataSmart information session (to be held in Sydney, Melbourne, Brisbane, Adelaide, Perth and Canberra at DataStart.com.au (I will be at the Canberra event, so feel free to say hi).

Read full post...

Saturday, September 05, 2015

GovHack 2015 International and National winners

Below is a list of all of the GovHack 2015 International and National winners...

The GovHack 2015 International categories had competitors across Australia and New Zealand: 

The International Best Disaster Mitigation Hack,
The International Digital Humanities Hack
International Bounty for Best WWI Hacks

The GovHack 2015 Australian National Major Categories were open to all Australian participants:

The Best Digital Transformation Hack
The Best Open Government Data Hack
The Best Science Hack
The Best Policy Insights Hack 
The Best Data Journalism Hack
The Best Entrepreneurial Hack

The GovHack 2015 Australian National Team Awards were open to all Australian participants: 

The Best Youth Team (18 years and under) The winning hack is:
Best Higher Education Team
Best Public Servant Team
Best Professional Team

The Australian National Bounty prizes were open to all Australian participants:

The most useful Product or Service for the Public Bounty
ABC regional bounty
The Statistics data bounty
The Charity data bounty
The Taxation data bounty
The Scientific data bounty
The National Map bounty
The Structure of government bounty 
The Air conditioner and energy bounty
The Geoscience Australia data bounty
The Intellectual Property data bounty
The Health and welfare bounty
The Open Source bounty
The Indigenous issues bounty

Read full post...

Tuesday, August 04, 2015

The Australian Government's entitlements issue is an opportunity for a Gov 2.0 solution

Practically everyone in Australia has followed the entitlements issue triggered by media reports of House of Representatives Speaker, and Liberal politician, Bronwyn Bishop's helicopter trip from Melbourne to Geelong over the last three weeks.

While at times other politicians were reluctant to criticise Bishop's expenses, on the basis that most politicians spend quite a bit of money in meeting the requirements of their positions, the public and media was almost universally negative towards the rolling revelations of expenses that seemed either not in the public interest, or more expansive than necessary in her role.

Now that Bishop has resigned her position as Speaker, with a decade of her expenditures being reviewed by the Department of Finance, and the Prime Minister has announced a new review of parliamentary expenditures and entitlements, including those of senior public servants, it's a good time to look at how digital technology could help Parliament and politicians to regain and build public trust as well as explain how and why politicians spend money in carrying out their duties.

There's a real opportunity to make it easier for politicians to submit expenses, improve the speed at which they're made public, and provide a mechanism for explaining the value of their legitimate expenditures, while making it much harder for inappropriate use of entitlements.

It's hard to believe, in today's world of electronic banking, myTaxmyGov and online accounting platforms like Xero, that parliamentarians still have to, by and large, manually collect their receipts and invoices and physically complete paper forms to claim and verify their legitimate expenditures.

The technology to digitally photograph and submit expenses directly into an online system is widely available, as is the capability to digitally verify that all expenditures are accurate and appropriate.

It is also easy to then make these expenditures visible to whoever needs to see them, and to conduct various forms of analysis and reporting (both automated and manual) to identify and query exceptions (such as extremely high cost taxi fares) and, of course, to repay any out-of-pocket work expenses that a politician may have incurred.

While off-the-shelf tools are not really designed for the type of visibility expected of politicians, it wouldn't be too hard to develop a digital system for capturing, querying, reporting and paying these expenses, with the ability for the public and the media to view, in near-real time, all expenses incurred by parliamentarians in their day-to-day roles.

It wouldn't be much harder to allow expenses to be analysed and compared, as the media is already doing in articles like this, to understand the relative spending by MPs and, over time, by Ministers in the same or similar portfolios. This would provide for better comparisons and consideration over time.

What would be truly visionary would be to build in mechanisms for the public to flag certain expenditures and request an explanation, allowing politicians (and their teams) to explain what they are doing and why - improving the democratic compact between politicians and their constituents. This could be based on a minimum threshold of 'please explain' requests and require all requesters to be registered in the system to minimise the risk of nuisance enquiries.

On top of this, the system could provide information on entire itineraries and politicians and their teams could include information on the outcomes of their expenditures. For example an overseas study trip that resulted in a report to parliament and a change in legislation could have these outcomes and outputs linked to the expenditure, helping to verify how valuable it was.

Some might see the above type of approach invasive, taking the view that, once elected, a politician should simply be trusted to do the right thing.

While I can sympathise with this perspective, the reality is that it hasn't been shown to be effective in the real world. Some elected politicians have been shown to misuse or misunderstand their entitlements, and the damage this does to the integrity of the parliament is extreme.

Trust in politicians is low - not just because of questions over their expenditures, but also because of broken promises, failed programs and continual infighting.

Redeeming the reputation of parliament can't be achieved simply by expecting the public to let bygones be bygones and start trusting politicians again, it must be won through positive examples and actions - as Malcolm Turnbull demonstrated in his tram and train trip from Melbourne to Geelong.

Creating a digital parliamentary expenditures system with full near-real time transparency would be a strong visible sign that politicians are committed to serving Australia, not to their own enrichment.

It would also help dispel misunderstandings about how and why politicians spend money and improve the understanding of how expensive it can be to be a politician - particularly one with a large electorate or significant travel requirements.

Of course there's still the need to review the entitlements system itself - or at least adopt the recommendations from the last review of entitlements, however with some shrewd application of Gov 2.0 thinking and digital tools, Australians could be confident in how their politicians behave, not simply confident in the rules that they are expected to follow.

Read full post...

Tuesday, July 28, 2015

The uneasy relationship between Freedom of Information and open data

 Freedom of Information (FOI) has always been a tricky area for governments, a delicate balance between accountability and exposure, with successive parliaments around the world tweaking their national and state FOI laws in attempts to prevent disclosures damaging to various governments of the day, while also meeting public and media demands for transparency.

We've seen the federal government in Australia retreat from some of the Freedom of Information (FOI) framework established under former governments, including the effective abolition of the Australian Information Commissioner by budget cuts, when legislation to end the office failed to pass the Senate.

With the three appointed Commissioners in the Office now having followed most of the rest of their staff into new rules, we have a temporary Australian Information Commissioner, for three months, as the government sorts out how to finally end the Office and transfer the function to a more formal, costly and time consuming review process.

This is far from the only tweak in recent times, with Australian FOI legislation also modified in 2013 under a former government to exclude parliamentary service agencies from FOI. This was termed fixing a loophole, that unfortunately allowed the public to request information such as a former speaker's expenses in detail.

Similarly in the UK it appears there's a retreat on FOI occurring, with the UK government calling an enquiry into FOI to look at whether they have the balance right.

What's interesting is that the UK is using its open data presence as part of the justification for the enquiry.

Open data and FOI are not always the same thing. Open data focuses on quantifiable datasets, generally numberical, that represents a current or past state for a given government service, or from data collected by government on a nation's social, economic or environment state.

While open data can expose issues in government, it is often used to identify opportunities and gaps that can be explored and improved on - leading to better services and outcomes.

FOI, on the other hand, is often far less about data and far more about correspondence, decisions and who made them. While open data may expose bad decisions, FOI exposes who made those bad decisions and, sometimes, the basis on which they were made.

That's why data is generally easier for government to release openly than documents. Exposing a bad decision can become a basis for better decision-making, while exposing a bad decision-maker can breach the public sector's responsibility to protect the government of the day, and their own senior staff.

I've previously spoken about the risk of governments using open data as a 'cover' for tightening FOI requirements, and in the UK case above, my concern appears to be being realised.

I've not yet seen this explicitly in Australia, however with the poor scrutiny of government in the media and our weak civic sector, it's likely to occur at some stage.

Don't get me wrong, I think it's fantastic to see the level of open data increasingly being released at federal, state and local levels across Australia. The snowball is rolling and we're beginning to see some of the value that open data enables - both within governments themselves and in association with the communities they serve.

However effective open data release should not become the primary way in which governments engage with Freedom of Information, nor a rationale for broadening exclusions to FOI.

As for FOI, we really need to rethink it at a fundamental level, politically, at public sector levels and in the community.

Currently (and from my experience within government), often those outside government are seen as 'the enemy', seeking to point the finger at people within government and 'bring them down'.

The reality is that government exists as part of society and must remain functionally effective and valuable. FOI can support this process, helping to identify issues and misconduct in order to improve trust in government and it's effectiveness in meeting community needs.

However this can only occur if those within government - and those without - treat FOI in this manner, as an accountability and transparency tool, not as a threat to their integrity.


Read full post...

Tuesday, July 21, 2015

How does government manage the consequences of an imbalance in speed of transparency & speed of accountability?

One of the emerging challenges for governments in the online age is managing the discrepancy between the speed of transparency and the speed of accountability.

With digitalisation and the internet, the speed at which government information is made public is becoming faster, with it being easier to collect, aggregate and publish information and data in near or even real-time.

We see this particularly in public transit data, where many cities around the world now publish real-time data on the location and load of their buses, trains and trams, and in the health industry where a number of states have begun offering near real-time data on the congestion in emergency waiting rooms.

We're also seeing similar near real-time reporting on river levels, dams, traffic congestion and closures, and estimated real-time reports on everything from population to national debt levels.

This trend is expanding, with the Sense-T network in Tasmania pioneering an economy-wide sensor network and data resource. Similarly the Department of Finance in Canberra is working on a system to provide real-time budget information on government expenditure down to every $500 for internal management and public transparency purposes.

This trend is a leap forward in government transparency, providing citizens, bureaucrats and politicians with far greater visibility on how our governance systems are performing and far more capability to identify trends or patterns quickly.

We're seeing a similar transparency event at the moment, with the expenses scandal enfolding the Speaker of the House of Representatives, Bronwyn Bishop, related to her use of a helicopter and several charter flights to attend political fund-raising events.

What this event has also highlighted is that while Australia's governance systems are increasing the speed of transparency, our capability to apply that information to accountable decision-making isn't consistently accelerating at the same rate.

In other words, while we increasingly can obtain the information needed for rapid decision-making, the entrenched processes and methods for decision-making in government are lagging far behind.

We see this in the failure rate of IT projects, which can drag on for years after it's clear they will fail, when laws fail to work as they should and it takes months or years to amend them, when the public has judged a politician's actions, but parliament can take no formal action for months due to being out of session.

Of course many sound reasons can and are given by bureaucrats and politicians as to why decisions need to take lots of time.

Decision-makers from the pre-internet world will say that they need to ensure they have all the necessary data, have digested it, reflected on it, considered alternatives and consequences, consulted widely and only then are able to tweak or change a decision.

This is a fair position with many defensible qualities - it reflects the world in which these people grew up, when decision-making could be undertaken leisurely while the world waited.

However both management theory and the behaviour of our communities have changed.

Start-ups grow and become huge companies based on their ability to make decisions rapidly. They are continuously experimenting and testing new approaches to 'tweak' their businesses for greater success. This is underpinned by streams of real-time data which show the consequences of each experimental change, allowing the organisations to adjust their approach in very short time-frames, minimising their potential losses from sub-optimal decisions.

The community equally reacts very quickly to evidence of poor decisions and bad outcomes, with the internet, particularly social media, fueling this trend.

While this doesn't mean the community is consistently in the right on these matters, it does require decision-makers to respond and address concerns far more rapidly than they've had to in the past - 'holding the line' or 'depriving an issue of oxygen' are no longer effective strategies for delaying decision-making into the leisurely timeframes that older decision-makers grew up with.

This issue in the disparate speed of transparency (data release) and accountability (clear and unequivocal response) is growing as more organisations release more data and more of the public is collecting, collating and releasing data from their interactions with organisations.

The imbalance is fast becoming a critical challenge for governments to manage and could lead to some very ugly consequences if politicians and agencies don't rethink their roles and update their approaches.

Of course governments could attempt to sit back and 'tough it out', trying to hold their line against the increasing speed of transparency and accountability. In my view this would result in the worst possible result in the long-term, with increasingly frustrated citizens resorting to more and more active means to have government take accountability for their decisions in the timeframes that citizens regard as appropriate.

My hope is that government can reinvent itself, drawing on both internal and external capabilities and expertise to find a path that matches fast transparency with appropriately fast accountability.

I'd like to see governments challenge themselves to test all of their historic assumptions and approaches - reconsidering how they develop policy, how they consult, how they legislate and how they engage and inform the community, in order to address a world where 'outsiders' (non-public servants) are identifying issues and worrying trends at an accelerated rate.

Perhaps we need a radical new ways to develop and enforce laws, that provide scope for experimentation within legislation for agencies to reinterpret the letter of a law in order to fulfill it's desired outcomes and spirit.

Perhaps we need continuous online consulting processes, supported by traditional face-to-face and phone/mail surveys, which allow government to monitor and understand sentiment throughout policy development and implementation and allow a 'board' of citizens to oversee and adjust programs to maximise their effectiveness over time.

Perhaps we need mechanisms for citizens to put forward policies and legislation for parliament to consider, tools that allow citizens to recall politicians for re-election or a citizen-led approach to determining what entitlements are legitimate for politicians and what they should be paid, with penalties and appropriate recourse for citizens to sack representatives who fail to uphold the values the community expects at a far greater speed than the current election cycle.

There's sure to be many other ideas and mechanisms which may help deliver a stable and sustainable democratic state in the digital age of high-speed transparency and accountability - we just need governments to start experimenting - with citizens, not on them - to discover which work best.

Read full post...

Friday, July 17, 2015

Have you visited data.gov.au lately? We're beginning to witness the 'Open Data Multiplier'

PS News has a great report on the growth of data.gov.au - linking to a report on the Department of Finance's blog which indicates the site added 100 datasets in June.

The site has also upgraded to provide more data visualisation capability for users, as well as a responsive template for improved mobile access.

Most interesting was the high use of the service over GovHack, with 4,755 user sessions by 2,618 users. The most popular datasets included intellectual property government open data 2015, ABC Local online photo stories 2009-2014 and sample household electricity time of use data.

I've written about some of the interesting Govhack prototypes over at The Mandarin in the article, GovHack 2015: a wildly successful idea that keeps spawning more, where I also wrote about how participation is a useful way for agencies to test and support 'edge' innovation without committing scarce personnel and funds.

From what I've been hearing over the weeks since Govhack we're reached something of a tipping point with open data in Australia, with governments beginning to seriously recognise the value of sharing data in this manner.

Those benefits are not just external to agencies, such as transparency, economic growth or community engagement, but also internal.

Internal open data benefits to government include improving agency decision-making (through greater awareness and access to collected data), improved data quality and fostering innovation and creativity.

As a result of reaching the tipping point, I expect to see continuing significant growth in the quantity and quality of open data available across Australia, as well as more targeted and useful data as agencies become more sophisticated in their data release (as I've outlined previously in my Open Data Generations Roadmap)

This will stimulate what I've termed the Open Data Multiplier.

As with the network effect, where the value of a network increases exponentially with the number of participants (think about telephones or the internet), the Open Data Multiplier means that each additional dataset released for reuse creates a growing number of possibilities to combine it with existing data, or use it on its own, to prompt even more interesting and diverse innovations.

However the Open Data Multiplier only operates when the community and agencies are engaged with open data. Without this community both inside and outside of the public sector, data sits 'on the shelf', generating no value at all.

This is where volunteer-run events like GovHack are valuable for fostering a positive civic hacking culture.

Agencies also have a role in fostering both an internal and external culture of data-based innovation through supporting GovHack and similar events, and running their own separate challenges on agency-specific topics (as Transport for NSW and Public Transport Victoria have done).

The internal benefits don't stop at data either. The same challenge model, once adopted by government, can be used more broadly for policy and service design and in finding diverse solutions for government problems - as has been successful in Challenge.gov and is used by VicHealth and thre ACT government.

Indeed I ran a similar service design challenge for the Victorian Government at GovHack, the first exploration of such an approach at that event. The learnings will help guide Victoria's government in identifying when to use similar approaches and in designing and running future challenges.

All of this follows on from opening up government data, creating a more permissive and experimental sandpit for innovation and sharing.

And it starts with a visit to data.gov.au - have you visited lately?

Read full post...

Wednesday, March 25, 2015

Use open data in your business or not-for-profit? Contribute to Australia's first formal Open Data study

Earlier this month the Department of Communication, in conjunction with New York University's GovLab team, launched the Open Data 500 research project as the first comprehensive study of Australian companies and non-profit organisations that use open government data to generate new business, develop new products and services, improve business operations or create social value.

The research initiative was launched by Communications Minister Malcolm Turnbull at the Locate15 conference on 11 March.

The results of the study will be used to develop a publicly available report that will help businesses to identify ways to reduce the costs of accessing government data, including licencing, versioning and control costs.

GovLab was founded by Beth Simone Novak, who was formally the United States deputy chief technology officer for open government and led President Obama's Open Government initiative.

If your organisation uses open data, or you know an organisation that does, please participate in this study. The more information available on how and why open data is used, the more attention it will receive from Australia's governments.

More information about the study, and the survey for businesses and not-for-profits to complete are available at the website - http://www.opendata500.com/au

Read full post...

Friday, February 27, 2015

It's a good time to rethink the approach to Australia's Census

The first censuses reportedly took place around 5,000 years ago in Egypt, and the approach is mentioned in Exodus, one of the books of the Bible, commissioned by God in order to levy a per capita tax to upkeep the Israelite Tabernacle.

The ancient Greeks, Chinese and Indians all conducted censuses before 1 AD, and censuses were vital for the Romans to levy the taxes that maintained their empire.

More recently, the Domesday book was commissioned by William the Conquerer, also known as William I of England, to properly tax the land he had conquered from the Saxons.

Independently the Inca Empire in South America, who had no written language, conducted censuses in the 15th century using base-ten notation knots in llama hair string.

In modern times over a hundred nations have conducted censuses on a regular or semi-regular basis, with nations like the US and UK conducting them every year and Australia every five.

A census collector from Egypt in 3000BC would probably have found it easy to comprehend the censuses Australia conducted in the 1990s.

While there's more questions today, the method of collecting census information had changed very little until recently.

Up until the introduction of electronic censuses this century, nations sent thousands of census collectors out and distributed millions of census forms for completion.  The collected data was then returned to central points for collation and analysis.

Now the ABS has prepared a paper to government suggesting that they may have better techniques for estimating population statistics rather than conducting an expensive national Census every five years.

This suggestion has caused media controversy, a public backlash and even a campaign to 'save our census'. Australians feel a sense of ownership over the Census, particularly after the fantastic work done by the ABS last census to engage people via social media and interactive tools.

However I think it's a good and appropriate conversation to have right now. We've advanced enormously technologically and scientifically in the last ten years, not to mention the last 5,000.

In fact, if you really think about it, conducting the census in a way that would be familiar to the Romans or William the Conquerer really doesn't make sense for the 21st Century.

With the data collection techniques available now, and the expertise we have in data analytics and prediction, surely we can find more cost-effective and less invasive ways of taking stock of our population than having every household fill in a form on one night.

So while I appreciate the concerns people have about change, and the nostalgia for our census-takers, I applaud the ABS and government for at least considering new approaches to the census.

If we truly want to digitally transform our government and society, we need to challenge practices that have become the norm.

This means not simply updating them (such as making a paper form electronic), but completely rethinking them beginning with our goals, applying the most appropriate approaches to data collection and analysis, and rethinking how we share and use the data for the benefit of society.

This needs to be done with an eye to improving outcomes, avoiding outcomes such as in Canada where it was about money, not quality. It also needs to be done with an effective change management campaign, involving the public in the debate.

Ignoring these two areas risks a messy and difficult process of reconsidering the Census, likely with poor outcomes both for the current government and for Australia.

However a well-thought-out public engagement campaign, combined with clearly superior techniques of collecting and analysing data could be a win for both.


I look forward to the day when children learn about the census in their history books, a system that was great for 5,000 years but was superseded by more effective techniques as humans advanced.

And I look forward to seeing more sacred cows in government and business challenged wisely and effectively with appropriate public engagement.

Read full post...

Thursday, February 19, 2015

WA government launches open data consultation

The Western Australian Department of Premier and Cabinet has launched a consultation regarding their proposed whole of government Open Data policy - citing the relative underutilisation of data and the prospect of unlocking opportunities for greater insights and services.

It's good to see WA take this step. While they've had data available openly, primarily through WA LandGate, there was no clear overall policy or direction taken by the government and relative immaturity in how agency data was published for reuse.

The consultation is designed to create a policy which supports a standard approach to open data across WA government and both educate and encourage agencies to understand the value of data and how to release it effectively and appropriately for reuse.

To read and comment on the consultation, visit www.dpc.wa.gov.au/Consultation/Pages/WAWholeofGovernmentOpenDataPolicy-Draft.aspx


Read full post...

Thursday, October 09, 2014

IP Australia releases open data including over 100 years of patent, trademark, design and plant breeder rights records

In a great step forward for Australian open data, IP Australia has, for the first time in history, released over 100 years of patent, trademark, design and plant breeder rights records as free publicly accessible and machine-readable data.

Released through data.gov.au (at https://data.gov.au/dataset/intellectual-property-government-open-data), while not a real-time feed, the information contained on Australia's innovation history is staggering.

Note that the main data file is 430Mb as a zip, it can take some time to download and process.

It will be interesting to see how this data might be used over the next year and particularly in future hack competitions, such as GovHack 2015.


Read full post...

Thursday, September 25, 2014

Civic hackers, government's hidden allies - an interview with Mark Headd of Accelera

This is the fifth in a series of interviews I'm doing as part of Delib Australia's media partnership with CeBIT in support of GovInnovate. I'll also be livetweeting and blogging the conference on 25-27 November.

For some people helping government use technology to better serve the public is their job, for others it’s their passion.

Mark Headd is firmly in the latter category.

Mark began his career as a government professional with a Masters in Public Administration working in New York’s state government in the late 1990s.

He fell into the technology sphere by accident, becoming interested in the burgeoning internet and how it was impacting society and government.

After stints as a policy advisor to the Delaware State Governor and then the state’s CIO Mark left government to start a new career as a programmer.

He taught himself how to code and worked as a software engineer for ten years.

Then, in around 2008, Mark came across Apps for Democracy, entered and won a prize and was hooked.

The competition reinvigorated his interest in government and how to leverage the skills and passion of people outside it to help.

He went to work for Code for America as Director of Government Relations, assisting governments to craft open data and civic participation policies and advocating for civic innovation.

Then Mark went back inside, working as the Chief Data Officer of the City of Philadelphia, developing and implementing an open data and government transparency plan for the city.

His latest move was earlier this year, to Accela, where he currently works as a Technical Evangelist, working with civic hackers to help governments improve how they operate and govern.

Mark told me that his biggest learning from the civic hacking movement in the United States was that there are lots of people out there who are interested, talented and want to help.

“They want to help because they care about their communities, not necessarily because they love particular governments. The sheer number of people willing and able to help is often surprising to public servants.”

Mark said that technology development and adoption are often difficult in government, “we are increasingly reaching a point where governments will implement technology in different ways.”

He cited the example of Healthcare.com in the US, where after a disastrous launch the President reached out to the private sector to help.

Mark says that governments often find that in the civic hacking community they have a hidden partner they’re not be aware of outside of government.

“However to take advantage of this governments must handle data a little differently, engage a little differently”.

Mark says that “it’s never been easier to make software or work with data, so more people are looking to government for access to these to help.”

In Mark’s experience, accessing this outside help shouldn’t be left to the technology or ICT teams, “these types of units tend to be internally facing, focused on serving the needs of other parts of government. There’s often not a lot of experience in these groups for engaging with external individuals and groups.”

He says that the first thing a government needs to do to get out of its own way was to involve people experiencedin external engagement.

“Engaging with civic hackers is simply engaging with a different cohort of citizens.”

Mark does believe there are some risks that governments need to mitigate when engaging these groups, but they aren’t insurmountable.

“There’s always the risk that a partnership won’t go well. However governments already have lots of risks that they have sound frameworks for managing.”

He said that the risk he most often heard was “how to we ensure we don’t release data that we shouldn’t release”.

To do this, Mark says, ask other governments what they’ve released and their experience of what is most used.”

There’s already agencies releasing data around the world, so the best way to mitigate a data risk is to find out what others have done and use their lessons learnt.”

He said that governments need to think about what data they want to make available and have used.

“Start with data that is already public but is malformed –such as in a PDF report or other format difficult to reuse. Once an agency has experience in these areas and infrastructure built to support it, move on to other data.”

In Mark’s view releasing data isn’t the end goal, “I believe that governments need to start thinking about their role in the civic technology chain.”

“If you ask a government IT employee they often self-identify as a builder, they build things that people use.”

“Governments need to realise that their role is changing. They will build less and become a platform, a steward, of the data that other people use to build things for the public.”

This sounds like a big shift, but as Mark pointed out, it’s no bigger than what we’ve already seen in the last ten years.

“If you had described to a government official ten years ago that it would be impossible to deliver services to the public or do their job as a public servant without the internet, they would have laughed at you and not believed it.”

“We’re in the same boat today – when you tell a public official that they won’t be building services for the public, instead releasing the data that allows others to build those services, many simply don’t believe it.”

Mark believes political leadership is important to foster open data and what lies beyond it.

“Politicians need to realise that people are going to get the data someway, somehow, so it is better to use it as an engagement tool and to build trust than to try and lock it down.”

He believes media criticism of government activities is going to happen anyway and that the potential for innovation and economic development far outweigh the short-term risk of people criticizing government.

“All around the world we see governments making announcements that they are committing to the open data movement. We also need clear measures to evaluate whether they are meeting their own commitments, something we can count.”

Alongside open data Mark believes that there’s room for discussing government procurement processes, particularly for buying and developing software.

“The Healthcare.gov issue occurred at a time when websites were easier to build than ever before. It was a real eye opener for people that the most powerful government in the world couldn’t do what a group of kids in tight jeans could do.”

“So we’re now having a really interesting discussion about how government could procure and develop software better.”

Mark says that we’re still in the early days for civic hacking and governments need to be prepared for a far more engaged future.

“Look at an event like GovHack, which has grown enormously over the last few years. We know events like this are going to continue to grow and they are going to want more data.”

What governments can do to prepared for that is to think about what data they can release and what can they do to leverage the interest to their own benefit.”

“That’s a huge opportunity for government. Let’s use the months before the next GovHack to figure out what data people want and use it to get some benefit for agencies and the public. How can government participate as a full partner?”

He identified there was a trend towards more specific hack events, on topics such as health and transport.

“This is a really good way for governments to get more focused participation on topics of concern to them.”

“The products and end results coming out of these events are very tangible to public officials, such as a transport app. I’m literally been at events where teams will present a finished product and government officials will say I get it now, I understand.”

He believes that as more of these targeted events are held, we’ll reach a tipping point where people running operational units in agencies understand how products and services can be derived from the data their agencies hold.

Mark said he was looking forward to presenting atGovInnovate to share some of the US’s experience with open data and civic hacking.

“I don’t know if people in Australia are aware of what is happening at state and local levels in the US. That’s where a lot of the really innovative work is happening.”

You’ll be able to hear more from Mark at GovInnovate on 25-27 November in Canberra.

Read full post...

Monday, September 15, 2014

A view on the maiden tweets of Australia's federal politicians

A politician's maiden speech in parliament is usually constructed with great thought and care. It serves as a platform on which they plan to stand for the rest of their term, the issues they intend to prosecute and the topics on which they prefer to engage.

However can the same be said of their first tweets?

I've compiled all of the first tweets of our currently sitting federal politicians (the 79% with Twitter accounts) into both a timeline and a word cloud to provide a glimpse into how much thought they put into their first declaration on this highly public platform.

You may judge for yourself whether the first tweets of politicians provides an insight into their character, interests and key concerns - noting that only one current federal politician created their Twitter account before entering politics.

Data: https://docs.google.com/spreadsheet/ccc?key=0Ap1exl80wB8OdFFaYk9NYkhPaXB6aU5yTDF0S21ocWc&usp=sharing

Wordle: www.wordle.net/show/wrdl/8140372/First_tweets_from_current_Australian_federal_politicians

Timeline: cdn.knightlab.com/libs/timeline/latest/embed/index.html?source=0Ap1exl80wB8OdFFaYk9NYkhPaXB6aU5yTDF0S21ocWc&font=Georgia-Helvetica&maptype=toner&lang=en&hash_bookmark=true&width=560&height=840

The most common words from the first tweets of current Australian Federal politicians

Read full post...

Tuesday, September 02, 2014

Kudos to Queensland government for taking a fun approach to their Premiers Awards for Open Data

Some of you might be aware that at the red carpet event for GovHack 2014 in Brisbane, the Queensland government's Assistant Minister to the Premier on e-government, Ray Stevens, announced the Premiers Awards for Open Data.

The Awards are a competition to come up with the best use of the 1,400 datasets released by the queensland government as open data in their data.qld.gov.au open data catalogue.

The competition has $77,000 in prizes up for grabs, and is fully international, open to anyone, anywhere in the world, without a requirement for any team members to be based in Queensland.

The competition is open until 26 September - so get your entries in.

Now to the kudos - normally these types of government open data competitions are rather dull affairs, with little in the way of fun or exciting promotion.

In this case however, Queensland has gone a little further than other states or countries, making a promotional video that takes a step away from the technical talk and has a little fun in the process while costing next to nothing.

It's the kind of approach we need to see more of from government - a little rough, a little fun and very sincere. View it below, then don't forget to enter!

Read full post...

Wednesday, August 27, 2014

Algorithm detected Ebola outbreak nine days before health authorities using internet posts

There's a great article over at TechRepublic by Lyndsey Gilpin on how the computer algorithm behind HealthMap detected the recent Ebola outbreak nine days before it was identified by health authorities.

In How an algorithm detected the Ebola outbreak a week early, and what it could do next, Gilpin describes how by tracking, collating and corroborating information published in online news sources and social media, the algorithm was able to identify the 'mystery hemorrhagic fever' over a week before official health agencies.

However the significance of the outbreak was not realised by HealthMap founders until after health authorities got involved.

This type of use of internet 'chatter' and algorithms to make sense of the world offers enormous potential for organisations to better identify and understand underlying trends.

For government this means the ability to identify outbreaks of human, animal and crop diseases earlier, detect early indications of potential crises and trends in population views and behaviours.

In all these cases it gives government the opportunity - using only public sources of information - to react sooner and more appropriately, containing problems and getting ahead of issues.

Equally this capability can be used by commercial entities for marketing and product development, by financial organisations for faster and better informed investment decisions and by activists, lobbyists, foreign interests and terrorists to identify weak points for destabilising a nation or gaining advantage.

It remains early days in this area - not as early as when Google first released its flu map for Australia back in 2009 - but early enough that few organisations are, as yet, investing in this area (giving them a huge advantage over rivals).

However with HealthMap's algorithms now successful at screening out over 90% of unrelated information, the value of using this type of approach in policy and service delivery has now reached the point of commercial viability, which should only accelerate investment and research into the area in coming years.

If Australian governments aren't yet mining the public internet for intelligence to help improve decision-making, hopefully it won't be long until they do - at least to contend against others who might use this intelligence for less than positive purposes.

Read full post...

Tuesday, August 26, 2014

Government agencies need to think open first with all content - example of the Clean Energy Regulator

Last week the Clean Energy Regulator released a calendar that illustrates when other government agencies use National Greenhouse and Energy Reporting data.

Called the National Greenhouse and Energy Reporting publication calendar, this is useful data for locating government reports on energy and climate change. It also serves a secondary role in highlighting the importance of the information collected and released by the regulator.

Now a calendar, by its nature, is simply a table of data - so it would make sense to release this calendar as data. Indeed as it is a public document, with no security or private constraints, it is a perfect candidate to be released as open data.

This would allow the calendar to be mashed up with other data on the topic to present, perhaps, a comprehensive calendar of climate change and energy research in Australia.

Indeed it would likely be simpler to release this calendar as data than as a formatted document, which would require additional formatting and conversion steps. This could also meet all government accessibility requirements, as well as making the data easily reusable by others.

So what did the Clean Energy Regulator do?

They released the calendar only as a DOC and a PDF.

*deep sigh*

It's clear to me that there's still a major disconnect in government regarding when and how to release data in an open way.

This is likely an education gap, but also a KPI gap. If public servants were required in their KPIs to ensure that relevant public content they were responsible for was published in an open and machine-readable fashion we might see some change.


Essentially agencies need to embed 'open thinking' at the start of their reporting and research processes, working from the basis that all data that is being released publicly - including content such as calendars, lists, financial accounts and more - should be available in a reusable open format.


In this case I've 'liberated' the data for the Clean Energy Regulator and let data.gov.au know, as I did recently for ACT Crime Statistics data.

In this case I've even improved the data by turning the month field into a working date, fixing the errors (where closing brackets were dropped), separating out web addresses as a new field and separating Department/Agency name from the note that follows it, thereby allowing Department/Agency to be analysed and grouped. (view it at https://docs.google.com/spreadsheets/d/1xlnfd0H9t4O1JzdNqhjfeUCw7Oxk1XN7DYM_WbAHZ-c/edit?usp=sharing)

I've also done some analysis on the number of reports by agency and month (as below).



This is the type of work that individuals like me should not be doing.

It's what agencies and individual public servants need to take responsibility for - particularly when opening up the data is actually simpler than locking it down into a less open form.

The National Greenhouse and Energy Reporting publication calendar is now (unofficially) available as a Google spreadsheet for reuse. The Clean Energy Regulator is welcome to take a copy and use it for their publishing updates.

You'll find it at:
https://docs.google.com/spreadsheets/d/1xlnfd0H9t4O1JzdNqhjfeUCw7Oxk1XN7DYM_WbAHZ-c/edit?usp=sharing


Read full post...

Friday, August 15, 2014

Who won GovHack's National prizes - analysis

I've done some work analysing who actually won the National awards at GovHack based on the official results at govhack.org/2014-winners/, and this is what I've discovered...

There were 87 National GovHack awards given out to Projects and Teams, with one GovHack subcategory (Best Science Reporting) unawarded. Of these, 66 awards were awarded to Teams for their Projects, and 21 to Teams as team achievement awards that were not for a specific project.

Every GovHack location except for Mount Gambier won at least one national award.

Fifty six different teams won awards (across the entire eighty seven awards), with the leading prize winner being Sarbii from Perth with five awards, followed by Jonathan and Wai, Michael de Hoog and R3K1 on four awards and another six teams winning three awards. Eighty per cent of winning teams won either two or one award.



Forty five projects won an award (across the sixty six prizes for projects). Show the Gap was the top awarded project, with four awards, followed by eight projects with three awards: CancerMash, Data-by-region comparator, Energy Calculator and Comparison tool, Sarbii - Search and Rescue, Stat.Map, The Hack Report, What is Gov (Baby don't hurt me) and When the Heck am I?

Again about eighty per cent of winning projects won one or two awards.



Looking at locations, Canberra was the biggest winner by number of prizes (24), followed by Sydney (17), Adelaide (13) and Perth (11).


By the number of prizes relative to the number of entries, noting that some entries won more than one prize so this overstates the actual share of entries that won prizes, the winning location was Tasmania (89%), followed by Canberra (77%), Sydney (68%) and Perth (61%).

The most prizes were awarded in the Team category (22), followed by Best Social Inclusion (Hack (14), Best Business Hack (13) and Best Digital Humanities Hack (12).



You can see all of these statistics and more, as well as links to all the winners, in my Google spreadsheet: https://docs.google.com/spreadsheets/d/18H4gWSuVLb5Mjt84YdymeXSlSaAxjY78lX5T90i6RmQ/edit?usp=sharing

There were also several prizes given to government agencies which I've not analysed:
  • Best Government Participation, won by the South Australian Government, with 2nd place shared by the Federal Department of Communication and The Australian Institute of Health and Welfare; and
  • Highest Voted Government Data, won by the National Library for Trove and 2nd place going to the Victorian Building Authority.
I've not analysed local awards, which are visible or linked from the bottom of the GovHack winners page.

Read full post...

Bookmark and Share