Showing posts with label data. Show all posts
Showing posts with label data. Show all posts

Wednesday, January 15, 2014

Rethinking government IT to support the changing needs of government

We recently saw a change in the federal government in Australia, with a corresponding reorganisation of agency priorities and structures.

Some departments ceased to exist (such as Department of Regional Australia), others split (DEEWR into two departments, Education and Employment) and still others had parts 'broken off' and moved elsewhere (Health and Ageing, which lost Ageing to the (renamed) Department of Social Services).

This isn't a new phenomenon, nor is it limited to changes in government - departments and agencies are often reorganised and reconfigured to serve the priorities of the government of the day and, where possible, create efficiencies - saving money and time.

These adjustments can result in the movement of tens, hundreds or even thousands of staff between agencies and regular restructures inside agencies that result in changing reporting lines and processes.

While these reorganisations and restructures - Machinery of Government changes (or MOGs) as they are known - often look good on paper, in reality it can take time for efficiencies to be realised (if they are actually being measured).

Firstly there's the human factor - changing the priorities and allegiances of staff takes time and empathy, particularly when public servants are committed and passionate about their jobs. They may need to change their location, workplace behaviours and/or learn a new set of processes (if changing agency) while dealing with new personalities and IT systems.

There's the structural factor - when restructured, merged or demerged public sector organisations need to revisit their priorities and reallocate their resources appropriately. This can extend to creating, closing down or handing over functions, dealing with legal requirements or documenting procedures that an agency now has to follow or another agency has taken over.

Finally there's the IT factor - bringing together or separating the IT systems used by staff to enable them to do their work.

In my view the IT component has become the hardest to resolve smoothly and cost-effectively due to how government agencies have structured their systems.

Every agency and department has made different IT choices - Lotus Notes here, Microsoft Outlet there, different desktop environments, back-end systems (HR and Finance for example), different web management systems, different security frameworks, programming environments and outsourced IT partners.

This means that moving even a small group of people from one department to another can be a major IT undertaking. Their personal records, information and archival records about the programs they work on, their desktop systems, emails, files and more must be moved from one secure environment to another, not to mention decoupling any websites they manage from one department's web content management system and mirroring or recreating the environment for another agency.

On top of this are the many IT services people are now using - from social media accounts in Facebook and Twitter, to their email list subscriptions (which break when their emails change) and more.

On top of this are the impacts of IT service changes on individuals. Anyone who has worked in a Lotus Notes environment for email, compared to, for example, Microsoft Outlook, appreciates how different these email clients are and how profoundly the differences impact on workplace behaviour and communication. Switching between systems can be enormously difficult for an individual, let alone an organisation, risking the loss of substantial corporate knowledge - historical conversations and contacts - alongside the frustrations of adapting to how different systems work.

Similarly websites aren't websites. While the quaint notion persists that 'a website' is a discreet entity which can easily be moved from server to server, organisation to organisation, most 'websites' today are better described as interactive front-ends for sophisticated web content management systems. These web content management systems may be used to manage dozens or even hundreds of 'websites' in the same system, storing content and data in integrated tables at the back-end.

This makes it tricky to identify where one website ends and another begins (particularly when content, templates and functionality is shared). Moving a website between agencies isn't as simple as moving some HTML pages from one server to another (or reallocating a server to a new department) - it isn't even as easy as copying some data tables and files out of a content management system. There's enormous complexity involved in identifying what is shared (and so must be cloned) and ensuring that the website retains all the content and functionality required as it moves.

Changing IT systems can be enormously complex when an organisation is left unchanged, let alone when when teams are changing agencies or where agencies merge. In fact I've seen it take three or more years to bring people onto an email system or delink a website from a previous agency.

As government increasingly digitalises - and reflecting on the current government's goal to have all government services delivered online by 2017 - the cost, complexity and time involved to complete  these MOG changes will only increase.

This risks crippling some areas of government or restricting the ability of the government of the day to adjust departments to meet their policy objectives - in other words allowing the (IT) tail to wag the (efficient and effective government) dog.

This isn't a far future issue either - I am aware of instances over the past five years where government policy has had to be modified to fit the limitations of agency IT systems - or where services have been delivered by agencies other than the ones responsible, or simply not delivered due to agency IT restrictions, costs or issues.

Note that this isn't an issue with agency IT teams. These groups are doing their best to meet government requirements within the resources they have, however they are trapped between the cost of maintaining ageing legacy systems - which cannot be switched off and they don't have the budget to substantially replace them - and keeping up with new technological developments, the increasing thirst for IT-enabled services and gadgets.

They're doing this in an environment where IT spending in government is flat or declining and agencies are attempting to save money around the edges, without being granted the capital amounts they need to invest in 'root and branch' efficiencies by rebuilding systems from the ground up.

So what needs to be done to rethink government IT to support the changing needs of government?

It needs to start with the recognition at political levels that without IT we would not have a functioning government. That IT is fundamental to enabling government to manage a nation as large and complex as Australia - our tax system, health system, social security and defence would all cease to function without the sophisticated IT systems we have in place.

Australia's Prime Minister is also Australia's Chief Technology Officer - almost every decision he makes has an impact on how the government designs, operates or modifies the IT systems that allow Australia to function as a nation.

While IT considerations shouldn't drive national decisions, they need to be considered and adequately resourced in order for the Australia government to achieve its potential, realise efficiencies and deliver the services it provides to citizens.

Beyond this realisation, the importance of IT needs to be top-of-mind for Secretaries, or their equivalents, and their 'C' level team. They need to be sufficiently IT-savvy to understand the consequences of decisions that affect IT systems and appreciate the cost and complexity of meeting the priorities of government.

Once IT's importance is clearly recognised at a political and public sector leadership level, government needs to be clear on what it requires from IT and CIOs need to be clear on the consequences and trade-offs in those decisions.

Government systems could be redesigned from the ground-up to make it easy to reorganise, merge and demerge departments - either using common IT platforms and services for staff (such as an APS-wide email system, standard web content management platform, single HR of financial systems), or by only selecting vendors whose systems allow easy and standard ways to export and import data - so that a person's email system can be rapidly and easily moved from one agency to another, or the HR information of two departments can be consolidated in a merger at low cost. User Interfaces should be largely standardised - so that email works the same way from any computer in any agency in government - and as much code as possible should be reused between agencies to minimise the customisation that results in even similar systems drifting apart over time.

The use of these approaches would significantly cut the cost of MOGs, as well as free up departmental IT to focus on improvements, rather than meeting the minimum requirements, a major efficiency saving over time.

Unfortunately I don't think we're, as yet, in a position for this type of significant rethink of whole of government IT to take place.

For the most part government still functions, is reasonably efficient and is managing to keep all the lights on (even if juggling the balls is getting progressively harder).

It took the complete collapse of the Queensland Health payroll project to get the government there to act to rethink their systems, and it is likely to take a similar collapse - of our Medicare, Centrelink or tax system - for similar rethinking to occur federally.

However I would not like to be a member of the government in power when (not if) this occurs.

Read full post...

Friday, October 18, 2013

Suggestions for governments stepping into open data

I've been completing a survey for the Spatial Industries Business Association (SIBA) related to the Queensland Government's open data initiative, where one of the questions asked Can you list or describe any learnings that would be useful in Queensland?

I've provided a number of my thoughts on this topic, having closely observed open data initiatives by government over the last five years, and written periodically on the topic myself, such as:


To share the thoughts I placed in the survey more broadly - for any value they have for other jurisdictions - I've included them below:

  • Data released in unusable formats is less useful - it is important to mandate standards within government to define what is open data and how it should be released and educate broadly within agencies that collect and release data.
  • Need to transform end-to-end data process. Often data is unusable due to poor collection or collation methods or due to contractual terms which limit use. To ensure data can be released in an open format, the entire process may require reinvention.
  • Open data is a tool, not a solution and is only a starting point. Much data remains difficult to use, even when open, as communities and organisations don't have the skills to extract value from it. There needs to be an ongoing focus on demonstrating and facilitating how value can be derived from data, involving hack events, case studies and the integration of easy-to-use analysis tools into the data store to broaden the user pool and the economic and social value. Some consideration should be given to integrating the use and analysis of open data into school work within curriculum frameworks.
  • Data needs to be publicly organised in ways which make sense to its users, rather than to the government agencies releasing it. There is a tendency for governments to organise data like they organise their websites - into a hierarchy that reflects their organisational structures, rather than how users interact with government. Note that the 'behind the scenes' hierarchy can still reflect organisational bias, but the public hierarchy should work for the users over the contributors.
  • Provide methods for the community to improve and supplement the open data, not simply request it. There are many ways in which communities can add value to government data, through independent data sets and correcting erroneous information. This needs to be supported in a managed way.
  • Integrate local with state based data - aka include council and independent data into the data store, don't keep it state only. There's a lot of value in integrating datasets, however this can be difficult for non-programmers when last datasets are stored in different formats in different systems.
  • Mandate data champions in every agency, or via a centre of expertise, who are responsible for educating and supporting agency senior and line management to adapt their end-to-end data processes to favour and support open release.
  • Coordinate data efforts across jurisdictions (starting with states and working upwards), using the approach as a way to standardise on methods of data collection, analysis and reporting so that it becomes possible to compare open data apples with apples. Many data sets are far more valuable across jurisdictions and comparisons help both agencies and the public understand which approaches are working better and why - helping improve policy over time.
  • Legislate to prevent politicians or agencies withholding or delaying data releases due to fear of embarrassment. It is better to be embarrassed and improve outcomes than for it to come out later that government withheld data to protect itself while harming citizen interests - this does long-term damage to the reputation of governments and politicians.
  • Involve industry and the community from the beginning of the open data journey. This involves educating them on open data, what it is and the value it can create, as well as in an ongoing oversight role so they share ownership of the process and are more inclined to actively use data.
  • Maintain an active schedule of data release and activities. Open data sites can become graveyards of old data and declining use without constant injections of content to prompt re-engagement. Different data is valuable to different groups, so having a release schedule (publicly published if possible) provides opportunities to re-engage groups as data valuable to them is released.

Read full post...

Thursday, September 19, 2013

Can government policy, reports and consultation documents be communicated through animated infographics?

Government reports are often dry - really, really, really dry.

They are also often wordy, complex, long and, due to these properties, largely incomprehensible to the broader community.

Government policy and consultation documents can suffer from similar conditions. They are often quite complex, long and structured in ways that make sense to career bureaucrats but not necessarily to the general public.

Many agencies also dislike this and make all kinds of efforts to provide summaries, to simplify language, use images and charts and use other techniques to spice up these often long and complex government documents.

However at their core, they generally remain documents, words on paper that would be familiar to the scholars of Middle-Ages Europe, to the Ancient Greeks, Romans and Egyptians and to the many dynasties of the Chinese over the last six thousand years - although they may now be distributed by electronic as well as physical means.

Surely modern society can devise better ways to communicate complex information than relying on an approach that is now around six thousand years old.

And we have - by drawing from techniques that are much older and more resilient in human cultures. Pictures, dance and song.

Now I don't expect governments to communicate their reports, policies and consultation materials entirely through the use of the performing arts. Not all our politicians or public servants are as accomplished singers as, say Chris Emerson, who can be viewed below communicating about government budget reporting and the Charter of Budget Honesty in song with his band Emmo and the Wipeouts on an episode of The Hamster Decides.



However with multimedia and the use of infographics it is now possible to communicate government information in far more engaging and understandable ways than ever before.

This is being done by some agencies already. The Department of Planning and Community Development in Melbourne made a series of animated infographics to communicate material from their consultation, PlanMelbourne (which I've been privileged to work on through Delib Australia).



The use is not yet widespread, with most government reports, consultation documents, policies and other material still released as words on paper - however what if it was.

What if governments mandated that agencies were required to follow a visual first approach for all materials they released to the public, only using words on paper as a secondary technique?

Could agencies rise to the challenge, communicating their material far more succinctly in visual form - a five minute video rather than a 200 page single-spaced, small-type report?

Not possible? Material too complex and long? Too many statistics to cover?

Maybe the examples below might shift a few opinions.

The first example is from the creator of PHD Comics, Jorge Cham. As an internationally renown animator Jorge asked students to describe their thesis in two minutes.

Jorge chose the best descriptions and turned them into animated infographics, such as the one below from Adam Crymble on Big Data and Old History.



Second is an example from Peter Liddicoat, a materials scientist at the University of Sydney and the winner of the Chemistry category in the 'Dance your PHD' competition.

Peter's PHD was on the topic 'Evolution of nanostructural architecture in 700 series aluminium alloys during strengthening by age-hardening and severe plastic deformation' - a wonderfully complex and obscure topic that doesn't seem to naturally lend itself to dance, but somehow works.



What I think these example demonstrate is that there are alternatives ways for government to communicate complex material. They no longer must rely on words on paper.

Certainly bureaucrats can argue that word on paper are easy for them to produce, that they satisfy a substantial proportion of the community and they have a long track record - that 6,000 years of history I mentioned earlier.

They can also argue that there's no silver bullet for communication, no technique that will satisfy 100% of the audience, and that is perfectly true.

However while governments may consider words on paper the default position, the lowest common denominator way of making information available to the public, I think they are often used as an excuse to be lazy and unengaging.

Paper make the lives of public servants and politicians easier. Paper documents are relatively cheap and fast to write, review, approve and distribute - none of which is a benefit to the intended audience and community or improves the outcomes of a consultation.

Mark Twain once said, “I didn't have time to write a short letter, so I wrote a long one instead.”

For governments words on paper are their long letters - the approach easiest for them, rather than for the recipient, their community or audience.

Agencies can now do better - using images, animations and video to communicate relegating words on paper to a back-up role.

I challenge them to try.

Read full post...

Wednesday, July 17, 2013

How should governments educate agencies about open data?

Australia now has eight whole-of-jurisdiction open data catalogues at state and federal level, alongside agency-based repositories such as at the ABS and Geosciences Australia.

There's now a recommendation, if not a clear mandate, that agencies release data in some kind of open form - although machine-readable data remains limited and some agencies have attempted to develop their own copyright processes rather than using a pre-existing scheme such as Creative Commons (the standard to by Attorney-Generals several years ago and implemented as default in several jurisdictions).

However the quantity of data released remains low - as does the quality and context around much of the data that has been released. Agencies still resist calls to release data, with some requiring FOI requests to prompt them rather than proactively provide data to the public for reuse.

While a growing group of public servants at both senior and junior levels are becoming more aware of open data, there is often still a low level of awareness about what open data means, why it is important, what agencies have been requested to do and what this means in practice.

This isn't an issue unique to Australia, it is a challenge in every jurisdiction releasing open data around the world - over 300 of them.

Fortunately some jurisdictions have recognised this issue and taken steps to address it.

A great example is the City of Philadelphia in the United States of America.

Philadelphia had been an early entry into the open data space, originally releasing its GIS (Geographic information system) data free to the public in 2001, long before the open data movement gained steam.

However they had lost steam by 2009, with other city, state and national governments moving forward with their own open data sites. As the city was in the midst of the GFC and couldn't afford to develop its own open data presence, it worked with a group of open data advocates and companies, who had an interest in accessing and using the data - particularly with Azavea, a data visualisation company.

The resulting site, OpenDataPhilly, is still a great example of a very usable open data site and the City has used it effectively to expose much of the data it already had made public and build on this with additional data.

However, like other jurisdictions, the City of Philadelphia struck the same issue in terms of many public servants not understanding the value or importance of open data. While I can't speak specifically for the City of Philadelphia's experience, this issue can lead to the gradual decay of open data sites, with few new datasets added, old data not being updated and data that is released not having been collected in ways designed to simplify and reduce the cost of publishing.

As a result, two years after launching OpenDataPhilly, the City's government has released the Open Data Guidebook, designed to provide practical guidance to City of Philadelphia departments and agencies on the release of open data to the public.

Released as a work-in-progress Google Doc and subject to regular updates, the Open Data Guidebook is an excellent guide for any jurisdiction seeking to increase internal awareness and understanding of open data and its value to government and the community.

Read full post...

Monday, June 03, 2013

GovHack 2013 - my top ten picks

Last weekend (31 May - 2 June) was a big weekend for Government 2.0 in Australia, with the first truly national GovHack held across eight locations, including seven of Australia's eight major states and territories.

With over $170,000 in prizes, and around 100 national and local prizes on offer, GovHack 2013 attracted 900 participants, who formed into 134 teams to create 124 apps using open government data - of which 108 were submitted by deadline.

Sponsors included a range of small, medium and large companies and included a number of government agencies, who used the event for inspiration on how open data could be used to generate new insights and improve public awareness and understanding.

I was unable to attend due to personal commitments, however kept an eye on the event remotely via the #govhack tag on Twitter, the event website and the online dashboard (image above).

The event, as anticipated, resulted in some awesome visualisations, tools and ideas - ranging from the visual mapping of immigration to Australia, which put asylum seeker arrivals in proportion; to the creation of jewelry based on open data.

Some awards have already been given out, with others to be decided by Thursday.

A process of public voting for entries is now underway - and you can vote for your favourite entries at http://hackerspace.govhack.org/

However here are my top ten favourite entries this year.

Immigration in proportion

This is an awesome way to visualise immigration to Australia, the type of visualisation that governments should be using to put data in perspective.

Explanation:
A visualisation of all immigration to Australia within 2011-12, created for Govhack 2013. Each dot represents one person.

Red dot: immigration through skilled entry, family reunion or special eligibility schemes.
Blue dot: refugees who arrive by boat (IMA = irregular maritime arrival).
Green dot: refugees who arrive by plane (non-IMA).

Refugees arriving through offshore resettlement (eg, from refugee camps overseas) are not currently shown.

Data is from Department of Immigration and Citizenship and Refugee Council of Australia.

Credits: Steve Bennett, Andrew Wise, Darren Yu.




Vote for it at: http://hackerspace.govhack.org/?q=groups/asylum-seekers-proportion-and-getting-sense-scale

Trove: Open it up

While I don't care much for the word games, I love the concept of Trove having its own Captcha - which government agencies could use to enlist Australians in crowdsourcing the digitalisation of our national newspaper archive.

View it at: http://ec2-54-253-113-204.ap-southeast-2.compute.amazonaws.com/
Vote for it at: http://hackerspace.govhack.org/?q=groups/open-it

APS Jobs Gazetter

The APS Jobs Gazetter takes Australian Public Service (APS) jobs information, drawing from the (PDF) APS Jobs Gazette and presents it graphically by type of job over time, based on search terms entered.

This makes it possible to track the ebb and flow of different job types in the APS, very useful for detecting changing patterns in employment over time that simply cannot be achieved via other APS resources.

View it at: http://gazetteer.pv.tl
Vote for it at: http://hackerspace.govhack.org/?q=groups/aps-jobs-gazetteer-exploring-public-service-jobs

Australia in review

It can be difficult to get a clear picture of the Australia's past - with data spread across many sources and many accounts giving a partial sense of each year.

Australia in review is a useful addition to this area, providing a useful and usable snapshop of Australia in each of the last 40 years - with the ability to expand to provide all kinds of custom information.

View it at: http://www.bradandglen.com/govhack/
Vote for it at: http://hackerspace.govhack.org/?q=groups/australia-review-air

Deathmatch.me

There's many preconceptions about the major causes of death in Australia, and deathmatch.me takes a lighthearted approach to correcting these, by presenting causes of death in one-on-one matches to the... er... death.

View it at: http://deathmatch.me/
Vote for it at: http://hackerspace.govhack.org/?q=groups/deathmatchme

Explorations in flight

Ever been interested in seeing where people come from to visit Australia, or how this has changed over the years?

Explorations in flight provides a 20-year picture of flight arrivals and departures for Australia, showing the rise in travel and changes in origin.

View it at: http://flinklabs.com/labs/flights/
Vote for it at: http://hackerspace.govhack.org/?q=groups/explorations-flight-httpflinklabscomlabsflights

Giving kids better health outcomes

This hack isn't simply interesting, but important for supporting parents and health professionals to improve the health outcomes for their kids by understanding local issues.

The data is currently only for South Australia, but hopefully will be increased to cover the entire country.

View it at: http://www.unleashed2013.org/dashboard
Vote for it at: http://hackerspace.govhack.org/?q=groups/giving-them-better-chance-life-analytics-meets-early-childhood-development

Survival kit for international students going to NSW

This site provides information for international students on where the best places are for them to stay, relative to the university they are going to attend.

I like it because it fills a need for a group who otherwise might struggle to make the best decision for themselves due to lack of familiarity with Australia.

View it at: http://govhack2013.kelvinism.com/
Vote for it at: http://hackerspace.govhack.org/?q=groups/stay-here-not-there-survival-kit-international-students-coming-nsw

The open index

How can the public critically assess which government agencies are being the most open? For that matter, how can agencies and politicians assess this?

The open index provides a useful way of measuring openness, using a variety of measures and approaches. Agree or disagree with the weightings (and it does need some work - for example more overdue QoNs is not a good thing), it is a valuable approach for providing some kind of comparison between agencies.

View it at: http://theopenindex.org/
Vote for it at: http://hackerspace.govhack.org/?q=groups/open-index

Where do my taxes go?

I like this Govhack entry as it demystifies where tax money goes - something that is very hard to get in a snapshot from the budget or any other government information.

This is the type of tool I expect to see from modern tax agencies. The fun facts are a blast too.

View it at: http://christonkin.id.au/govhack/final/index.html
Vote for it at: http://hackerspace.govhack.org/?q=groups/where-do-my-taxes-go

Read full post...

Tuesday, May 21, 2013

Is there really an open data El Dorado?

I was reading a tweet yesterday from Australia's CTO, John Sheridan, and it raised an interesting question for me.
Is government open data really a new goldmine for innovation?

The Economist's article, A new goldmine, makes a strong case for the value of open data through examples such as GPS, the Global Positioning System which is owned by the US government (who owns the satellites), but has been provided free to organisations around the world since 1983.

I've also seen fantastic studies in the UK and Australia talking about the value in releasing public sector information (PSI) as open data, and great steps have been taken in many jurisdictions around the world, from Australia to Uruquay, to open up government silos and let the (anonymised) data flow.

I agree there's fantastic value in open data; for generating better policy deliberations and decisions, for building trust and respect in institutions and even for stimulating innovation that leads to new commercial services and solutions.


However I do not believe in an open data El Dorado - the equivalent of the fabled city of gold - where every new dataset released unveils new nuggets of information and opportunities for innovation.

Indeed I am beginning to be concerned that we may be approaching a Peak of Inflated Expectations (drawing on Gartner's famous Hype cycle chart) for open data, expecting it to deliver far more than it actually will - a silver bullet, if you will, for governments seeking to encourage economic growth, transparency and end world hunger.

Data is a useful tool for understanding the world and ourselves and more data may be more beneficial, however the experience of the internet has been that people struggle when provided with too much data too quickly.

Information overload requires humans to prioritise the information sources they select, potentially reinforcing bias rather than uncovering new approaches. Data can be easily taken out of context, misused, distorted, or used to tell a story exactly the reverse of reality (as anyone closely following the public climate change debate would know).

Why assume that the release of more government data - as the US is doing - will necessarily result in more insights and better decisions, particularly as citizens and organisations come to grips with the new data at their fingertips?

A data flood may result in exactly the reverse, with the sheer volume overwhelming and obscuring the relevant facts, or the tyranny of choice leading to worse or fewer decisions, at least in the short-term.


The analogy of open data as a gold mine may be true in several other respects as well.

The average yield of a gold mine is quite low, with many mines reporting between one and five grams of gold per tonne of extracted material. In fact gold isn't even visible to the naked eye until it reaches 30 grams per tonne.

While several hundred years ago gold was easier to find in high concentrations and therefore easier to extract - leading to many of history's gold rushes - over time people have mined most of the highest gold concentrations.

Extraction has become laborious and costly, averaging US$317 per ounce globally in 2007.

There is definitely gold in open data, value in fresh insights and innovations, opportunities to build trust in institutions and reduce corruption and inefficiency in governance.

However if open data is at all like gold mining, the likelihood is that the earlier explorers will find the highest yields, exploring new datasets to develop insights and innovations.

By the gold mine comparison we are currently in the open data equivalent of the gold rushes, where every individual who can hoist a line of code can dig for riches as a data miner, while data analysis companies sell spades.

Following the analogy, data miners will shift from open data site to open data site, seeking the easy wins and quick insights.

However as the amount of open data grows and most of the easy wins have been found, it will get more expensive to sift increasing amounts of data for fewer insights, requiring greater and greater investments in time and effort to extract the few remaining nuggets of 'gold'.

At that point many government open data sites may become virtual ghost towns, dominated by large organisations with the ability to invest in a lower yield of insights.

Alongside these organisations, only a few tenacious data mining individuals will remain, still sifting the tailings and hoping to find their open data El Dorado.

Read full post...

Thursday, May 16, 2013

Register for the May Gov 2.0 event in Canberra

I've realised I'd not yet blogged about this month's Gov 2.0 event in Canberra, which is being run by the Department of Finance and combines the Gov 2.0 crowd with the Australian Government's  Cross Agency Social Media Forum.

The event - which is coming up next Thursday, 23 May at DEEWR's auditorium on Marcus Clarke street, features four speakers on social media in the public service:

  • Tom Burton from the ACMA to discuss his work and strategy;
  • Evan Hill from PM&C to present about the APS Policy Visualisation Network;
  • Felicity Lawrence from ACT Government to present about her PhD research project on social media in the public service across Australia; and 
  • Pia Waugh from the Department of Finance to briefly present about the APS online engagement courses Finance are running. Please see below for more information.
For more information and to register visit the EventBrite page at: http://casmmay2013.eventbrite.com/

Read full post...

Wednesday, April 10, 2013

Web and social media reporting can help Communication get a seat at the decision-makers' table

Yesterday morning I attended the first OPC IT WebEx event for the year, where we heard from three great speakers on intranet development, accessibility and the changing face of the media in Australia.

One particular statement that stuck in my mind was from David Pembroke, CEO of Content Group, who said that it was important for communications people to bring numbers to the table to gain a seat alongside other decision-makers, such as CFOs and CIOs who already have numbers in hand to support their positions.

While most agencies now track the traffic to their website and report raw numbers of followers, comments and mentions on their social channels, I believe there's still a way to go before these numbers are provided in the right way to the right people at the right time to help Communications areas - and particularly Online Communications - have the impact and the influence it deserves.

This has been brought home to me by Slideshare, which recently began sending me reports on the number of views and interactions on the various presentations I've uploaded to the service over the years.

Simply being able to see these basic stats has made me take more notice of the material I'm putting on Slideshare and whether or not it has a wider audience that I should consider when developing my slides.

I'm even considering paying money for an account to get more detailed statistics that will help me finetune material to better match what audiences want.

When working in Government I did place a considerable amount of effort into providing web statistics back to the areas responsible for specific content. I believe this type of reporting is critical to help policy and program areas receive regular and actionable feedback on what they are putting online to help inform their customers, clients, stakeholders and other audiences.

In fact, without web reporting many of these areas only receive ad hoc and irregular feedback on the content they are producing - an annual survey, or some Ministerial Correspondence. This makes it harder for them to understand whether their content is targeted correctly and also means they place much lower emphasis on what they are communicating online - what isn't measured isn't managed or valued.

Now with social media in the picture, web reporting needs to jump to a higher level of competency. While agencies might have made some steps to ensure that various areas of their business are receiving reports on the content they are providing through websites, the new frontier is to provide them with actionable information on what people are saying about their programs and policies across the broader web.

This helps areas within agencies not only assess how people are responding to the information they do provide online, but also gives them some understanding of what questions and issues are being discussed due to the lack of content.

In other words, web reporting helps tell agencies the quality and effectiveness of their own website content. Social media reporting helps tell agencies about the community's content needs beyond existing content.

The benefits to agencies of this social media monitoring are immense, not only can we capture known unknowns, but also the unknown unknowns - intelligence that could shape the entire way a program or campaign is designed and communicated.

It is also very important to differentiate social media monitoring from media monitoring - something that is getting harder to do as media monitoring companies move to bundle social within their media offerings.

Media monitoring tracks what commentators say about an agency and its activities when posturing to a broad audience.

Social media monitoring tracks what your customers and stakeholders are saying about an agency and its activities to each other.

In other words social media monitoring can provides a granular and specific view on what your actual customers think and understand about specific programs and how they interact with them in the real world, while media monitoring only provides a shallow reputational view on what people are saying for an audience - which may simply be an act.

So while there is a clear incentive for Online and Communication teams to roll social media monitoring in as an extension to (traditional) media monitoring, it can be dangerous to consider the intelligence received through both avenues in the same light.

As agencies get better at both web reporting and social media monitoring, and develop standardised ways to communicate actionable insights to the right people, at the right time, we're likely to see more ability for the groups providing these insights to have meaningful influence on agency decisions. This is right and proper - better information leads to better decisions and outcomes.

However it is up to Communication and Online teams and their leadership to recognise how web and social monitoring can advance their ability to positively influence decisions and take the lead on providing insights, otherwise they will find themselves on the margins as more traditional numbers-orientated disciplines take over the responsibility for these activities.

Read full post...

Wednesday, April 03, 2013

Opening the vault - Open data in Queensland - watch the livestream

Today the 'Opening the vault' event is being held in Brisbane, discussing open data in the context of the state.

Following from the Queensland Government's commitment to open data (with the appointment of Australia's first e-Government Assistant Minister), the event was opened by Premier Newman and is being livestreamed on the web - demonstrating the level of importance placed on this area in the state.

You may follow the event on Twitter using the #dataqld hashtag, and watch the livestream at data.qld.gov.au.

Keep an eye on the session after 11:30am Queensland time (12:30pm AEST) for the finalists in the latest data competition and to vote on who should win.

I've also embedded the livestream below.

Streaming by Ustream

Read full post...

Monday, February 18, 2013

Gov 2.0 and public sector innovation needs both business and technology heads

At the Gov 2.0 lunchtime event last week (video coming soon), Darren, Manager, Media and Community Information, from the ACT's Emergency Services Agency talked about how closely he'd worked with Richard, his technical lead, to create their social media presence and new website.

He proudly told us the website had cost only $43 to build, using internal skills and an open source platform, and was hosted in two locations - Sydney and Melbourne - allowing it to scale to two million users per hour.

He talked about the iOS app his team had built, 'The Spot', which allowed the agency to post to the website and social media at any time from any place, and was being extended to support keyword-based social media monitoring - again at low cost.

It made me realise something I've known for a very long time, but not really put into context in a government sense.

To develop successful cost-effective Gov 2.0 solutions, organisations need the same skills as a entrepreneurial start-up company - a 'hustler' and a 'hacker', or in more politically correct language, a 'business guy' and a 'technical guy'.

Thinking back over all the successful websites and Gov 2.0 initiatives I've delivered, they all involved these two sets of skills,

As for myself, I'm the 'hustler' - with the skills to dream big dreams, identify market gaps and process improvement opportunities and sell them (at least part of the time) to the people who control the purse strings.

I've always worked with at least one 'hacker' - someone with the ability to turn concepts into code, ideas into reality. Whether it at a large government agency, or a tiny start-up, whether developing a national consultation platform for health, a map-centric data site or a leading games reviews site, without a hacker, many of my ideas can't get realised. Without a hustler, many hackers can never navigate the 'people web' to get the resources and support required to realise big dreams.

Of course there are rare exceptional individuals who are both in one package - hustler and hacker. However they are often not as successful as expected due to the sheer time required for both tasks and they can burn out extremely quickly if left to flounder to design, sell and deliver all on their own.

Hustling requires research, networking, contracts, following processes and jumping hurdles. Hacking involves intense thought to translate ideas into a developable concept and concentrated coding to realise the vision.

Government agencies seeking to innovation or implement Gov 2.0 initiatives need to look to build successful combinations of hustlers and hackers to succeed in their goals by integrating people with business heads with those with technical heads into the same 'cross-functional' teams.

If your agency is looking to promote innovation or adopt Gov 2.0 techniques, then take a leaf out of the book of organisations designed to innovate. Don't assign a business innovation champion, but neglect to involve ICT, or have the ICT team responsible for Gov 2.0 with no idea on what they are meant to do (and little time to do it in anyway).

Identify your hustlers - people good at coming up with ideas and selling them to management - and introduce them to your hackers - the coders who your other coders go to for help.

See where the sparks fly, which hackers and hustlers find common ground - ideas of what they believe should be done in order to replace how things are done.

Foster and support these pairs and larger groups, give them the opportunity and space to fail, and to succeed.

Then you'll see the innovations flow, new ideas for using technology to solve old problems and fix process gaps, ways to save money and improve performance - both incremental and disruptive approaches to change your agency into a productive, effective and risk-balanced organisation.

Read full post...

Tuesday, February 05, 2013

Mainstream media takes first steps in adopting open data hacker culture

On Monday 4 February The Age hosted the Data Newsroom event, where teams had an opportunity to dig into three previously publicly unreleased datasets,
  1. Political party funding data, which lists what companies donate money to which political parties.
  2. A database that includes the archives of all Age articles along with key words and relationships between those keywords.
  3. Weather data for Australia going back one-hundred years. 
 As reported by the Australian chapter of the Open Knowledge Foundation (OKFN), 14 teams consisting of journalists, hackers and citizens took on the challenge of producing an article from one of the datasets and convincing a 'Dragon's Den' panel of data journalists of the merits of their approach.

Four shortlisted teams got to go to the public lecture by web inventor, Sir Tim Berners-Lee, at Melbourne  University where the winner was to be announced.

To follow what happens and who wins, follow the OKFN blog at http://au.okfn.org/2013/02/05/the-data-newsroom/


Read full post...

Infographic: The top government Twitter accounts in Australia

In January 2013 I found that the total tweets by all government agencies and councils in Australia I track had exceeded one million.

As a reflection of that achievement I've worked through the data I have on the use of Twitter by government agencies and councils in Australia to produce the following infographic (scroll for more).

I'll be producing state by state (including territories and federal), local and topic-based infographics as a follow-up over the next few weeks, with more detailed information.

I'm considering writing an academic paper on the use of Twitter by government in Australia in case there's any academics out there who would be interested in co-authoring.

Read full post...

Wednesday, January 16, 2013

Infographics: How does Australia compare on government open data released?

I've developed several infographics (below) comparing the open data performance of nations, looking at which have national open data sites, how many sites they have across different government levels and how many datasets have been released through their national sites.

It's not a way to judge 'winners' and 'losers' - or even to compare the relative performance of countries. However it provides useful information on who is doing what and how deeply open government has been embedded in the thinking of agencies. This said...

There are 41 countries listed (by data.gov) as having open data websites, out of almost 200 nations.

In their national open data sites, in total, these nations have released at least 1,068,164 data sets (I was unable to get a count from China, Timor-Leste, Tunisia or Sweden's national open data sites), for an average of 28,869 and a median of only 483 - due to a few high release countries (US, France, Canada).

How do Australia and New Zealand rank?
As people will look for this anyway, based on the number of datasets released as of January 2013, New Zealand is 9th (with 2,265 datasets) and Australia 11th (with 1,124 datasets).

Between us is Estonia, with 1,655 datasets.

The top nations above New Zealand are, in order: US (378,529), France (353,226), Canada (273,052), Denmark (23,361), United Kingdom (8,957), Singapore (7,754), South Korea (6,460), Netherlands (5,193).

Infographics




And finally, as a tree map showing the relative size of nations by datasets...




Raw data
The raw data is available in a spreadsheet at: https://docs.google.com/spreadsheet/pub?key=0Ap1exl80wB8OdFNvR3dja3E4UGtVVi1LMU11OFBmR1E&output=html

Caveats
When it comes to nations and states there's few absolute measures, there's simply relative performance - across jurisdictions or across time.

These comparisons are often flawed due to variations in data collection, lack of information or differences in approach, however there can still be value in 'placing' nations, identifying opportunities, challenges, flaws and risks.

My work above is not a measure of the success of open data itself, but provides a relative indicator of which governments have been more successful in embedded open government principles in agencies, and how deeply. It also provides insight into wich nations are working in this space.

My data spreadsheet is also a useful 'point in time' reference to track changes over time.

Note that I was unable to count open data released outside of national open data sites - there's a lot more of this, however it can be harder to locate. Due to the sheer number of state-based open data sites (210), I've not yet done a tally of the datasets they've released, only of the 41 national sites. Watch this space :)

The data may not be 100% accurate due to differences in the approach to releasing data. data.gov provided the list of data sites and I drew specific information on datasets and apps from all 41 national open data sites, each with a different design and functionality and across over a dozen languages.

Please let me know of any inaccuracies and I will endeavour to correct them.

Read full post...

Friday, November 23, 2012

The latest infographic about Twitter - Australians the third most active users

The Twitter infographic below has been brought to my attention by The Wall and I thought it worth reflecting here.

As you'll see below, Australia is rated the third most active nation on Twitter, behind the US and UK and just ahead of Brazil, Canada and India.

There's some useful general demographics on Twitter's global audience, though I'm still waiting for the time when Twitter releases country-based demographics before it becomes possible to really assess Twitter's value as a promotional medium.

Right now for I'm tracking 633 government accounts in Australia (excluding politicians), including the latest addition, @ACTGIO.

The infographic was compiled by www.website-monitoring.com.



Read full post...

Wednesday, October 31, 2012

Enterprise social networking - the latest infographic

I thought this infographic from the US on enterprise social networking from Tibbr, released in July 2012, was worth sharing.

Particularly notable was how high an adopter of these types of tools was government ('Public Administration') at 74%, which closely reflects the share of Australian Government agencies I've tracked as now using social media officially (73%).



Read full post...

Thursday, October 25, 2012

How should governments treat mobile apps in an age of open data?

EmergencyAUS app
I had a very interesting conversation the other day regarding the challenge of government mobile apps in the age of open data.

The example used was the EmergencyAUS app, which has been developed by Gridstone Pty Ltd.

As an app created by a commercial entity, EmergencyAUS aggregates emergency information released by a variety of state and federal agencies and presents it through a single interface.

The public can also take photos of emergencies and share them through the app. Best of all the app is free to use

Alongside this, Australian governments have also released mobile apps related to disasters and
DisasterWatch app
emergencies. Federally there is Disasterwatch, released by the Attorney-General's Department, which also aggregates emergency information from a variety of state and federal agencies.

At state level there's several emergency apps now available, but particularly notable is the Victorian Country Fire Association's CFA FireReady app.

This is available across all major mobile platforms and while it focuses on Victorian fire emergencies (including backburning), it also allows the public to take photos of emergencies and share them through the app. These photos can even be used by the CFA to help inform their staff regarding developing issues.

Essentially the commercial app and government apps are competing. They all aggregate information from openly released emergency and disaster data and all have a similar aim - to help inform Australians of critical events occurring near them or near their families and friends.
CFA FireReady


Generally governments in Australia take the position that they do not compete in providing services where commercial entities are prepared to do so. They essentially try to minimise where they compete with private enterprise.

So this example raises some clear issues. As government releases more data in reusable formats (open data), there are likely to be more commercial entities who use this data to create mobile apps or other services.

So should governments stop making apps for this data, and leave the field to commercial entities?
Should governments restrict themselves to apps for data that doesn't have commercial value?
Should governments continue to compete against private firms in creating apps?

To answer these questions I think it is vital for government to begin to think about mobile apps (and websites for that matter) as strategic assets and infrastructure rather than costs or PR tools.

Mobile apps as infrastructure

Government built the telephone network in Australia because it was not commercially viable for a private player to invest in this type of infrastructure. We're now repeating this process with the NBN. We did the same with roads, electricity networks, water networks, the Commonwealth Bank, Qantas and other core infrastructure.

However past a certain point it became viable - even desirable - to sell some of this infrastructure to private concerns, with appropriate legal safeguards in place (such as foreign ownership in Qantas and Telstra's universal service obligation).

To develop some new infrastructure governments began looking at public private partnerships - such as toll roads and utilities such as ActewAGL (the ACT's electricity provider).

These have either taken the form of co-investment in development, and co-ownership in some fashion, or the form of complete private ownership, with the government simply providing incentives, support or ideas to the private sector.

Finally there's infrastructure that government has been totally hands-off during development - such as for mobile networks and for virtual infrastructure including search engines.

Mirroring these to mobile apps (or websites), there's five categories for government to consider:

  • Critical - apps which governments consider core to its ongoing business and therefore both creates and maintains, retaining ownership on an indefinite basis (though commercial entities may create their own versions).
    ie: Emergency management apps, train/tram/bus timetable apps
  • Very important - apps which governments believe must be provided and will make, however are not critical for them to own on an ongoing basis, and therefore may sell to private concerns (with appropriate distribution and maintenance conditions and perhaps a 'resumption' clause if the private concern ceases development)
    ie: Traffic or toilet map apps.
  • Important - apps which governments prefer are developed, but are only prepared to partially invest in - via partial funding or other support or a partnership with private entities.
    ie: Crime statistic/locations, parliamentary information or library/gallery works apps.
  • Interesting - apps that governments find interesting, but not worth investing in. In this case they may release the ideas and data for the apps and leave up to private enterprise to develop - or not.
    ie: Sports field locator or health information apps.
  • Uninteresting - apps which government doesn't care (from a public benefit perspective) whether they are created or not and leave entirely to the private sector.
    ie: most apps you'll find in app stores

Based on this model government agencies need to think about the criticality of a particular app to their core business and act accordingly, treating the apps as an infrastructure investment.

Here's examples of my thinking.

Critical apps
Emergency and disaster apps can be considered critical public safety tools, provided by governments to ensure citizens are informed and supported in times of crisis.

As a core function of government, while private sector organisations may also develop them, agencies would still develop and maintain good quality apps to ensure public safety and information concerns are met.

While commercial entities may develop similar apps, this is not a reason for government to cease maintaining its own, as the government must ensure that a service is provided to the community and commercial entities may stop maintaining - or even withdraw from sale - their apps at any time, leaving a gap that the government's apps will continue to fill.

Very important apps
Traffic apps, while very important for managing traffic congestion and supporting productivity, are not core to the responsibilities of government agencies, but offer significant public value.

Therefore governments would develop these apps, but potentially may sell them to private concerns to maintain and profit from, with provisos that they deliver a certain quality of information and, should the private company decide to stop maintaining the app, the code and app go back to the agency (like an exploration lease for minerals).

The sale of these apps should be considered a cost-recovery exercise as well as pricing the value of the service to the community, ensuring that the public receive some return for the value transferred from public to private hands.

Important apps
Parliamentary information apps, such as ones providing Hansard feeds and information on proposed laws and parliamentary schedules are useful and important to government, however are not essential, or very important to government. Hence it makes sense for government to contribute to the development of these apps - financially or through support - however government shouldn't invest in their creation.

Co-investment might be done through grants or matching funds - such as if a private entity ran a Pozible or Kickstarter fund raising activity and an agency agreed to match up to $X dollars raised.
Support might include access to key individuals, research or data which would support the creation of these apps, or promotion of them through Ministers and agency media contacts and networks (potentially with a level of endorsement).

Interesting apps
Interesting apps, such as one providing the location of all sports fields in a city, might be suggested by a council or agency as an idea, based on data they've released or an identified community need. A paper prototype or business case prepared, but rejected, within the agency may even be released to flesh out and provide context and direction for the app. However agencies and councils would not deem these apps important enough to co-invest in or support, leaving it up to the private sector whether to take on and own the idea or not.

Charging for mobile apps

Another consideration for governments is whether they should charge for apps they create and manage.

I have mixed views on this. There are definitely services that government provides as 'user-pays'. Why should people who don't use the app share in paying for its development and maintenance?

Charging for an app can also provide some funding for its maintenance and improvement over time - very useful where government agencies provision for app development, but have a time limit on funding for it to be maintained and improved, updated to reflect changes in mobile operating systems or even released on new platforms as they emerge.

However in many of these cases the mobile app may not be core to government service provision and potentially could be provided by the commercial sector rather than the public. Perhaps it should be sold off, or left to private hands rather than maintained by government.

If there's a mobile app that your agency is considering charging users to buy or use, perhaps, instead, it is a candidate for sale to a commercial entity to run and maintain, with the sales price being the value of the app.

Or if it is core for government agencies to provide as part of their service mix, should it really be charged for?

In summary


When having a discussion in your agency regarding whether you should make a mobile app, or leave it to the private sector to do - or are thinking about charging users a fee to buy or use your app - it is useful to consider the five categories above and into which your mobile app fits.

If the app is core to your agency's operations it should probably be developed and managed under your agency's watchful eye. If it isn't core, you should think about how important it is and use this to frame your decision on whether to build it yourself, support a private entity to do so or simply give the idea away.

Read full post...

Wednesday, October 24, 2012

Free our data - a great presentation from Pia Waugh

Open Data advocate Pia Waugh spoke recently on the topic of freeing government data at Ignite Sydney 9 (an event where speakers get five minutes and 20 slides to say their piece).

It provides a strong view as to why governments need to open up data to the community and is definitely worth viewing and sharing.

Read full post...

Thursday, October 11, 2012

Don't forget to register for October's Canberra Gov 2.0 lunchtime thingy

On the 18th of October is the next Canberra Gov 2.0 lunchtime thingy, with a focus on open data, data visualisation and new approaches to policy development through policy visualisation.

As usual we have two fantastic speakers:

Pia Waugh, an open government and open data ninja working with the ACT government as an Open Government Policy Advisor, will provide a report on her trip to the global OKFestival, a thousand-person conference focused on open government, open data and data analaysis/visualisation in Helsinki.

Evan Hill, the Methodology and Infographics Manager within the Strategy and Delivery Division of PM&C will be discussing policy visualisation and the newly launched APS Policy Visualisation Network.

For more information, or to register, go here.

Read full post...

Tuesday, October 02, 2012

Making APIs for government data - should agencies do this or leave it to third parties?

APIs (Application Programming Interfaces) are a technique for interacting with data (usually on the web) which liberates users from relying on particular applications or having to do complex programming to reuse the data in interesting ways.

Unfortunately few government agencies go the extra distance to release their data with an API, instead using specific data formats which require specific applications to access them.

This is a real shame, as APIs essentially makes data application free - great for accessibility and both easier and faster for any web user or website to reuse the data effectively.

It is often relatively easy for to create APIs from an agency's released data, as demonstrated by the Farmer Market API example from Code for America, which took less than an hour to convert from a spreadsheet into a map visualisation.

Agencies can certainly take the position that they don't want to do the extra work (however little it may be) to provide APIs for their public data and leave it up to third parties to do this - wherever and whenever they wish.

This is a choice, however, that comes with risks.

Where an agency simply 'dumps' data - in a PDF, CSV, Shapefile or other format online, whether via their site or via a central open data site - they are giving up control and introducing risk.

If a third party decides to create an API to make a dataset easier to access, reuse or mash-up, they could easily do so by downloading the dataset, doing various conversions and clean-ups and uploading it to an appropriate service to provide an API (per the Family Market API example).

Through this process the agency loses control over the data. The API and the data it draws on is not held on the agency's servers, or a place they can easily update. It may contain introduced (even inadvertent) errors. 

The agency cannot control the data's currency (through updates), which means that people using the third party API might be accessing (and relying on) old and out-dated data.

The agency even loses the ability to track how many people download or use the data, so they can't tell how popular it may be.

These risks can lead to all kinds of issues for agencies, from journalists publishing stories to people making financial decisions relying on out-dated government data. 

Agencies might see a particular dataset as not popular due to low traffic to it from users of their site, and thereby decide to cease publication of it - when in reality it is one of the most popular data sets they hold, hence a third party designed an API for it which is where all the users go to access it.

As a result of these risks agencies need to consider carefully whether they should - or should not - provide APIs themselves for the data they release.

Open data doesn't have to mean an agency loses control of the datasets it releases, but to retain control they need to actively consider the API question.

Do they make it easy for people to access and reuse their data directly, retaining more control over accuracy and currency, or do they allow a third party with an unknown agenda or capability to maintain it to do so?

Agency management should consider this choice carefully when releasing data, rather than automatically jumping to just releasing that CSV, PDF or Shapefile, or some other file type.

Read full post...

Monday, October 01, 2012

Victorian Government launches consultation on draft 'digital by design' ICT strategy

The Victorian Government has announced it is seeking public feedback on a proposed ICT strategy, Digital by design developed by the Victorian Information and Communications Advisory Committee (VICTAC).

The draft provides advice on the future management and use of ICT by government and how the Victorian Government can design and use information and technology to deliver better services.

The public consultation is for just over two weeks, finishing on 17 October.

The strategy sets out objectives and actions focused in three key areas and proposes eight principles to guide ICT decision making (per the chart below).

While not focused on Government 2.0, the draft strategy takes into account the increasing digitalisation of communications, expectations of citizens and the need to increasingly co-design and co-produce policy and service deliver programs and to design code for reuse, as well as the need to embed innovation within ICT and release more public data.


To learn more and to leave comments, visit www.vic.gov.au/ictstrategy/

Read full post...

Bookmark and Share