Tuesday, September 15, 2015
Now it gets interesting - Australia has its first digitally literate Prime Minister | Tweet |
Thursday, June 19, 2014
The economic value of open data to Australia | Tweet |
The report was written by Nicholas Gruen (former chair of the Gov 2.0 Taskforce) and his team from Lateral Economics, with support from Victoria University and commissioned by the Omidyar Network (the not-for-profit organisation established by eBay's founder).
It makes a compelling economic case for open data, estimating aggregate direct and indirect value for Australia was in excess of $15 billion per year. This was based on estimating the economic value of open data just across the G20's seven priority areas, which I've provided below as a table.
G20 priority area |
open data value
per annum to Australia
|
Anti-corruption |
$1.5 billion
|
Employment |
$3.4 billion
|
Energy |
$1.7 billion
|
Fiscal and Monetary policy |
$3.6 billion
|
Infrastructure |
$3.6 billion
|
Trade |
$1.6 billion
|
Relative progress on open government data areas Source: http://theodi.github.io/open-data-barometer-viz |
During the presentation Martin Tisne from the Omidyar Network said that Mexico and India had demonstrated leadership in opening up education data, while South Africa had taken great steps with open budgetary data - making the point that different nations have excelled in different aspects of openness, but few had demonstrated consistent strength across all aspects of open data.
The report included a great deal of detail on different areas in which governments could achieve economic value through open data - and also highlighted that the cost of realising these benefits could be up to a third of the value received, giving a clear signal of the need for government to invest in this area, not simply allow it to thrive or die on its own with no support.
Both Nicholas Gruen and Tony Shepherd, head of the Commission of Audit, highlighted the need for senior Ministerial leadership, and Gruen noted that no Australian Prime Minister had ever been a passionate supporter of open data, to Australia's detriment where the US and UK had significant political as well as public service leadership for openness.
The presentation also highlighted some of the current pitfalls for entrepreneurs seeking to take advantage of open data while there was no consistent commitment to its release.
Gruen illustrated this point by discussing APSjobs.info, a site created at a past GovHack, that mashes up data on public servant movements from APSJobs.gov.au. He said there was clear added value realised via APSJobs.info, which could be a useful reference tool for recruiters and agencies seeking to identify the best talent.
The report states that:
APSJobs.info's business model was predicated on its development of successful technical methods to 'scrape' the data from pseudo-print PDFs. However frequent changes to the formatting and layout of these files meant continuous re-development of the PDF conversion software to continue to access and add value to the data. The skills required to perform such work (data-mining and text-analysis) are in great demand, and the cost of frequently using such resources exceeded the benefits to Pivotal Analytics.APSJobs.Info is now defunct - a casualty of government inconsistency.
The Open for Business: How Open Data Can Help Achieve the G20 Growth Target report is highly material in establishing the value of open data to governments and the steps they need to take to realise the economic value that could result from greater release of reusable data.
Hopefully Australian governments will continue to build their commitments to open data and we'll see some of this value filtering back into our economic.
Wednesday, December 11, 2013
How do we avoid the chicken & egg of open data (and the failure of the opendata movement)? | Tweet |
Cap Gemini estimates that open data was worth 32 billion euros in 2010 to Europe, growing at 7% per year, while McKinsey estimates the global value at US$3 trillion per year and the UK estimated earlier this year (PDF) that the value of releasing their geospatial data alone as open data would be 13 million pounds per year by 2016.
There's been a range of similar reports across the world (as aggregated by the Open Data Institute) - all of which point to a similar conclusion.
However realising this economic value, in productivity, efficiencies and direct revenue, is dependent on governments doing one thing that they've so far failed to do - releasing open data in a planned, consistent and managed way.
Thus far most governments have followed a haphazard route to open data, releasing the 'low hanging fruit' first (data already in releasable form, with few privacy concerns and considered 'low risk' as it doesn't call into question government decisions), and then progressively releasing esoteric and almost random data sets at inconsistent intervals.
Many governments have clear processes for individuals and organisations to request the release of specific data sets - however a clear process which doesn't support the goal is of little value.
These requests have little influence on agency decisions on releasing data and I have yet to see any government mandate that these requests need to be officially considered and actioned or responded to within a set timeframe.
Without any real weight or structure, processes for requesting data sets can't be relied on by people seeking to build a business on open data.
Data consistency is an even bigger issue. In nations like Australia the federal and state governments each have their own open data sites. However there's no agreed national strategy on data release. Every jurisdiction releases different sets of data, with few attempts to aggregate state-level data into national datasets covering all jurisdictions.
Even when similar data sets are released by different states this is complicated at the back-end by different laws, different collection techniques and frequencies and differences in analysis and measurement approaches - not to mention differences in formats and naming conventions. This can make it costly, if not impossible, for businesses or individuals to aggregate data from different states and use it for a national goal.
On top of this, many agencies still resist calls to release data. Some due to a closed culture or a hope that 'open data' is a passing fad, others due to the costs of reviewing and releasing data (without any ability to offset them in fees or additional funding) and some due to concerns around data quality, political impact or reputational damage to the agencies themselves.
My fear is that we're reaching a chicken and egg impasse - agencies and governments are reluctant to do the work and spend the money required to develop consistent data release approaches and mandates without seeing some the economic value from open data realised. Meanwhile individuals and organisations are reluctant to build business models on a resource that is not reliably available or of a consistent quality.
There's no commercial model for open data if governments can turn off specific data, or entire open data initiatives on at a whim (as we saw data.gov shut down recently in the US Government shutdown). Businesses need to be able to count on regular publication of the data they use to build and inform their enterprise.
There's also a lot less value for governments in releasing their data if companies are reluctant to use it (due to a concern over the above situation).
So how should countries avoid the chicken and egg issue in open data?
There's two approaches that I have considered that are likely to work, if used in tandem.
Firstly, governments must mandate open data release and take appropriate steps to develop ongoing data release approaches, which clearly and publicly state what data will be released, at what frequency and quality level. This should include a data audit establishing what an agency owns (and may release) and what it doesn't own, as well as the collection costs and frequency of specific datasets.
To maximise the value of this approach for states within a nation there needs to be a national accord on data, with states (or as many as possible) developing and agreeing on a consistent framework for data release which works towards normalising the collection, analysis and release of data so that it can be aggregated into national datasets.
Secondly there needs to be thought put into the difference between open and free data. Individuals and organisations who use government open data for personal, educational or not-for-profit use should be able to access and reuse the data for free. However where they are using open data for profit (at an appropriate threshold level), there should be the scope for financial contracts to be put in place, just as there is for most other resources used to generate profits.
This approach would provide a revenue stream to the government agencies releasing the data, helping offset the collection and publication costs. Contracts should also be structured to provide insurance for the data users that the data will be released on a set timetable and to a defined quality level throughout the life of the contract.
There would need to be significant thought into how these financial contracts would be structured with significant flexibility built in - for example allowing cost-recovery for developers, who may spend many hours developing and maintaining the services they build with government open data and avoiding the upfront fee model which becomes a barrier to new entrants to make profitable use of open data. There would also need to be consistency in these contracts nationally for state data - potentially a major challenge in Australia.
However if implemented thoughtfully and with significant consultation and ongoing review, a combination of rigour in data release and cost-recovery for profitable use of government open data would avoid the emerging chicken and egg issue and provide a solid and sustainable foundation for realising economic value from open data - value that would help support Australia's economy, social equity, education and scientific research into the future.
Saturday, March 31, 2012
Australia goes mobile - 47% of net connections via mobile devices | Tweet |
It now seems Australia is on the verge of following the same path, with the ABS reporting that as at 31 December 2011, 47% of internet connections in Australia were via mobile devices.
The report, (8153.0 - Internet Activity, Australia, Dec 2011), has some other interesting findings as well...
- The number of internet connections grew by 11.0% in the year to 31 December, and by 6.3% since the end of June 2011.
- Mobile wireless grew fastest, with a 14.7% increase since the end of June 2011.
- The number of dial-up connections continued to decline, to 475,000 - still a substantial number, but representing only 4% of the total 11,596,000 internet connections in Australia. Of those 379,000 (3.2%) were households, the rest businesses.
- The number of dial-up connections declined 17.9% (from 579,000 to 475,000) since June 2011.
Note the ABS state the decline was 16.7% - I don't know why our calculated figures differ.
- More Australians remain on connection speeds less than 8Mbps (55%), however a good proportion are on 8-24Mbps (34.3%). Only 0.3% are on connections greater than 100Mbps.
- The total data downloaded was 345,518 Terabytes (or 345,518,000 Gigiabytes) for the three months ending 31 December 2011. This was an increase of 26% since June 2011 (remember the number of connections only grew by 6.3% so we're all downloading more).
- The average downloaded per connection was 29.8 Gigabytes (Gb) for the three months so, on average, we download 10Gb per month.
- However dial-up users only downloaded, on average, 67 Megabytes (Mb) of data per month, while broadband users downloaded an average of 10.3 Gb of data - showing a massive difference in usage.
- There were 91 ISPs in Australia with more than 1,000 subscribers - remaining a competitively very robust market.
There is a clear paradigm shift for users when upgrading to dial-up to broadband, with usage increasing by over 15,000%.
This representing a change from email and basic web browsing to the use of the internet as a multi-media interactive entertainment, engagement and service delivery environment.
It will be interesting to see the the paradigm shift in usage from users on fixed internet connections to mobile. I believe this is even greater as the services relevant to mobile users are very different to those relevant to static users.
Perhaps we can take another lead from Japan on this, based on the use of mobile internet during and following their recent tsumani.
Or learn from these five cities benefiting from mobile apps.
Tuesday, March 06, 2012
Stop waiting for the messiah and do it yourself | Tweet |
"It's not right for us", they say, "our audience isn't online" or "doesn't want to engage with us" or "we don't understand the risks" or "we're not ready yet" or "we're waiting for a critical need".
I'd like to say to all of these organisations - stop waiting for the messiah and do it yourself.
As has been shown through research, humans often make decisions first and justify their actions later - which means that most of these so-called reasons for not engaging online are justifications, not evidence.
How do you know whether a new tool will work for you if you don't experiment and pilot? How will you build the expertise you may need when there is a critical need for you to use these channels?
We've seen this behaviour in industries like retail, where a major retailer, Harvey Norman, is now pulling back from use of the internet because it didn't meet their projections on revenue. How did they work out those projections without experimenting online? Why did they not meet the projections and how will pulling back increase their success?
Given the internet has been a valid sales channel for fifteen or more years and some of the largest retailers in the world, such as Amazon, have built themselves online, how could any organisation in retail claim that online isn't viable, or delay entering the market - at least in an experimental way - for over ten years?
If you're not yet engaging actively online via social media just stop waiting for the messiah - that person or reason that makes it 'compelling' for you.
The compelling reasons are that 95% of Australians are online, that other businesses are building their expertise online, that online is the second biggest media today in Australia.
Online no-one cares that you're not there - but they are talking about you - truth and otherwise.
You wouldn't wait until an emergency occurred before building your emergency management systems. You wouldn't wait until you were in court before preparing your defence.
Organisations have case studies to learn from, examples of good practice and a range of resources and tools available to experiment with online, which allow you to learn the ropes without leaving you hanging.
If you're not building your experience now then how do you expect to build it in the future? Do you think your business will be able to afford the talent needed to leapfrog a ten-year or more advantage from your competitors, rivals and detractors?
Is delay really worth the risk?
Wednesday, September 28, 2011
Who controls what online? | Tweet |
It provides an interesting perspective on which major companies provide which services and collect various types of data.
Take a look over at the Web 2.0 Summit map (the movements view is very cool - click on the service icons above the menu).
Thanks @dasharp for bringing it to my attention.
Wednesday, November 10, 2010
Whether to reuse or build - government choices in a connected world | Tweet |
There's been discussion on Twitter over the last day about whether Australian government should be building online platforms, such as a video aggregation and distribution service, URL shortcut tools (which Victoria have done) or collective infrastructure for hosting and developing all government websites.
This has been an area of on-and-off discussion for over a year in the Government 2.0 context, with several Gov 2.0 Taskforce projects exploring potential opportunities for Australian governments to build systems such as these.
I expect this to continue to be a debate for many years. Choosing whether to build a service, or tap into a commercial one, can be a tough decision - even tougher online than it is in the physical world.
Why so tough a decision?
For starters, many of the services which government could use are hosted overseas, therefore posing some level of sovereign risk - whether that be,
- a concern over whether the service will continue to provide what Australia needs (when foreign laws and business policies may change),
- that personal or secure data might be accessed and misused by another jurisdiction (especially all those people who only use one password), or
- that it might provide an entry point for hackers seeking confidential and secret government information.
In many cases government created systems could have to be developed to the extent where they are commercially competitive in order to attract the level of user traffic needed to justify their continued existence.
So how to reconcile these differing perspectives... There's no single answer in my view. Decisions need to be made case by case. What makes sense for some jurisdictions won't for others and decisions that are right for one type of service won't be for another.
In lieu of an easy answer, I offer up four tests that I believe these types of reuse or build choices need to consider.
- Will it reduce private sector competition?
In other words, is the government competing directly against enterprise. If so there may be job and tax implications. Generally Australian governments shy away from entering commercial markets except when private enterprise is unwilling or unable to deliver the services to the entire population at a fair price.
- Will government deliver a superior outcome?
This tests whether a government-run enterprise will provide a better outcome than a private sector organisation. Strange as it may seem, governments are better at providing some services and outcomes than private industry - particularly where equity or public value is an issue. If the government can deliver a superior outcome there is a strong case for stepping in - if private sector companies miss out then they need to look at whether they should have restructured.
- Will it attract a significantly large and appropriate audience?
It is very important to consider whether a government-run service will attract enough users to make it worthwhile. For example, Facebook has build its audience over a number of years, holding on to them through being so useful that people cannot abandon it without damaging their social networks. If the bulk of the audience use Facebook, would they use 'Govbook' - a government equivalent service, even if it is a superior product? The answer may not always be yes - and without audience a government service may not achieve its goals.
- Is it sustainable?
In asking this I mean will a government continue to support and run the service over an extended period of time - perhaps even transitioning it to a private concern. Or is it possible that funds will be cut to a level where the service is unable to continue to innovate and improve, thereby seeing the service slip into irrelevance. Funding maintenance alone is no longer sufficient to address the rate of development online.
However I think that applying these tests will support more effective, evidence-based decisions - particularly in light of the large number of demands on government resources and time.
Thursday, May 07, 2009
High speed broadband for Australia - the unexplored country | Tweet |
This morning I am presenting at Public Sphere #1 - High bandwidth for Australia in a personal capacity.
The event will discuss what high speed bandwidth can do for Australian society, business and government.
I have previously posted some ideas on this topic and will be talking today about how the killer applications and services for a 100Mbit plus service are likely to not have been invented yet.
For those not attending the event, I have attached my presentation below and will add a transcript in the near future.
I will hopefully be liveblogging the event after my presentation throughout the morning.
Saturday, January 31, 2009
Do our internationally accessed government sites speak the right language? | Tweet |
Comscore's media release last week indicated that Global Internet Audience Surpasses 1 billion Visitors, According to comScore.
While this is probably an understatement, as it only accounts for those aged 15+, the release highlighted the increasing diversity of internet users, with China very clearly in the top spot with 179,100,000 users, compared to the 2nd placed US's 163,300,000 users.
Australia didn't even make the top 15 list, with the Netherlands scraping in at 15th spot with 11,812,000 users.
It is immediately clear than people with English as their first language are a minority on the internet.
Looking at the top 15 countries, the only ones with English as an official language were the US, UK and Canada (which has French as well). These countries only accounted for 221,173,000 of a total 711,488,000 internet users.
Extending this out to the full 1 billion internet users, only around 31% of internet users are likely to have English as their first language.
This means that for internationally focused government websites there is an enormous need to consider two options:
Rewriting websites to use extremely simple language and navigation for people who have English as a second language (or even as their first!) This is possibly the greatest need for most government websites - speaking to someone at a party last week, although they lecture at an Australian university, English is their second language and some government-speak in websites does not make sense to them.
The other, and harder, option is to co-publish in other languages, such as (written) Chinese, Japanese, Spanish, German, French, Hindi, Russian, Korean and Italian (by rough order of prominence).
Yes there's a cost to both of these approaches. However are you willing to tell your Minister that your internationally focused website is only accessible to 31% of its prospective audience in its current form - and you're OK with that?
Fortunately our tourism industry has gotten this message, Australia's official (government) tourist entry point Australia.com.au is available in eight languages and with localised content for more than 18 countries.
But what about people seeking business ties in Australia, those wanting to register their IP, anyone with a need to understand local laws or to claim benefits?
Over in Europe it is common practice to publish government and commercial websites in multiple languages - they are part of a European community as well as a global one.
How connected is Australia to our global community? Perhaps the languages we use on our websites indicate that we're not as connected as we could be - and one can only wonder at the value of this lost economic activity to Australia.
This is a whole-of-government issue, so perhaps we need a whole-of-government solution. A central team that works with agencies on a prioritisation basis (by economic impact) to convert their material into other languages - centrally budgeted of course.
Or should we rely on the audience to seek their own translators - either machine-based online ones, their employees, friends and families (with potential limited english understanding) or even paid services?
Thursday, December 18, 2008
A wonderful time for public sector recruitment and big egovernment infrastructure projects | Tweet |
While speaking to a colleague earlier in the week about the rush on access to government support in some areas of Australia due to the current economic conditions, I realised that it is a very good time for the public sector to build capacity and skills.
The IT skills crunch has affected Australian government for some time, with the private sector able to be more flexible and agile in adapting job descriptions and remunerations to suit market needs. International pressures have not helped, with many of Australia's top people drawn overseas due to the challenges and financial opportunities.
Now that private organisations around the world are feeling the financial pinch, there is the opportunity for the public sector to reinvent itself as a stable and reliable employer, emphasising the value of stable jobs within a less stable global economy.
This would have the following benefits for the Australian public,
There are also direct benefits for the APS,
It does require government to move quickly to resource key government agencies to expand their capabilities. This kind of agility has been difficult for government in the past without clear political leadership.
Most of the above benefits for government recruitment stretch beyond egovernment to other aspects of public sector service provision. If we can draw in the skilled people looking for stability and ensure that government provides a positive employment experience, we can build lasting capacity across the public sector.
What do others think - should government be growing in a time of recession?