State of Open Con 2025

Let us fight ignorance and prejudice in the world by enriching the most important sources for generative AI — Wikipedia and Wikidata—with accurate information based on reliable and established sources.
And let us use AI to simplify and accelerate that process.
The end result will be an improvement of the most trustworthy foundational data that ChatGPT, Claude, and all other models rely on for their training.
With the help of truth, in the form of credible sources, we can combat misinformation, right-wing extremism, dictatorship, and Russian propaganda.

This talk will cover Green Web Foundation’s most recent open source project - carbon.txt.

In it Hannah will explain:

- The problem this project addresses - the difficulty in finding and using sustainability data that is already published into the public domain.
- The web-first, connect not collect style approach that underpins how it works and how it is designed to be extended by default.
- How people can get involved in using the code or data the project surfaces.

Data lakes on open table formats like Iceberg are a popular way to manage large datasets for analytics, data science, and AI. This talk explains how data lakes work and how to adapt open source analytic stacks to use them. First, we'll tour projects like Arrow, Iceberg, and Unity Catalog that make data lakes possible. Next, we'll see how analytic engines like DuckDB, ClickHouse, and Spark are adapting. Finally, we'll survey a few projects that enable applications written in Python, Golang, or Rust to deliver fast query. You'll have to build the app yourself but this talk will show you a path to use data lakes and open source successfully.

The concept behind Stream emerged back in Spring 2020 when eight water companies came together and agreed that it was better to explore the potential of open data together rather than each going it alone. Roll forward to the end of 2024 and Stream is now a well-established collaborative initiative between 16 of the UK’s major water companies and seven partners all with a shared vision to unlock water data to the benefit of customers, society and the environment.

The member water companies have progressed from publishing three simple datasets at the end of 2023 to 69 datasets in just under 12 months, including near real time event data relating to the high profile topic of storm overflow discharges.

Solid data sharing foundations have been put in place (people, process, data and technology) and the strategy for 2025-2028 has been agreed. The icing on the cake came as Stream was recognised at the 5th Open UK Awards, being awarded winner of the Open Data category.

But it hasn’t been all plain sailing. We got lots of things wrong on the way.

As Stream members, we have actively sought out and benefited from learning from other data sharing initiatives so we wanted to take this opportunity to tell the stories of what we got wrong, what we learned and ultimately, how we got a few things right.

Imagine the inevitable has already happened—you’ve had a security breach—and you’re now dealing with the aftermath. Organisations must act fast to ensure business returns to operations quickly while also figuring out how to prevent similar incidents in the future. By adopting new use cases, engineering teams are simultaneously accelerating the deployment of sensitive data across multi-cloud architectures and tapping into new risk factors.

In this talk, we will use the “Data Security Bang” analogy and learnings from resilience engineering to answer questions such as: How could we do more left of bang (prevention) to help with the speed of right of bang (remediation)? The audience will be guided through a set of example scenarios in a 90s-style game, using Kanister, OPA, and Prometheus, in which they can make decisions on data security to guide the way towards a more robust infrastructure.

As artificial intelligence transforms industries, its success hinges on the quality of data and navigating evolving regulations. This talk delves into practical strategies for leveraging data effectively, addressing key challenges such as data transparency in the public sector and data sovereignty in the private sector.
We’ll explore trending AI use cases, showcasing real-world applications, and examine how impending regulations could shape AI’s future. Attendees will gain insights into balancing innovation with compliance, ensuring ethical and effective AI deployment.

Perseus makes it easier for UK SMEs to access green financing by automating their sustainability reporting.

Learn how Perseus will unlock access to finance from banks and lenders to UK SMEs to reduce their emissions faster and quantify the impact of such finance. Its objective is to reduce emissions faster.

Perseus is amongst the most advanced cross-sector smart data schemes in the UK, bringing together strategic target sectors of energy and finance, convening an outstanding constellation of stakeholders to co-design and implement the solution.

Come along to this session to find out more about this innovative approach to sharing data, changing behaviour, and achieving Net Zero.