The stunning capabilities of modern AI systems give rise to many questions regarding how they work and how much more capable they can possibly get. One way to gain additional insight is via synthetic models of data with tunable complexity, which can capture the basic relevant structures of real data. In recent work we have focused on sequences obtained from random walks on graphs, hypergraphs, and hierarchical graphical structures. I will present some recent empirical results regarding how transformers learn sequences arising from random walks on graphs. The focus will be on neural scaling laws, unexpected temperature-dependent effects, and sample complexity. If there is time, I will also discuss the effect of parameterization strategies on hyperparameter scaling laws, where we see the critical importance of appropriately scaling the embedding layer learning rate.
The classical action, or more generally the path integral, is a convenient framework for extracting the physical consequences of symmetries. In recent years, new symmetries of gravity in asymptotically flat spacetime have been uncovered based on relations to soft theorems governing the S-matrix. I will discuss a program to understand these symmetries using a formulation in which the S-matrix is identified with the action subject to asymptotic boundary conditions. This formulation of the S-matrix is analogous to the GKP/W formulation of the AdS/CFT duality and shares many of its advantages, albeit with new subtleties due to working in asymptotically flat spacetime.
High-Performance Computing (HPC) drives discovery across science and industry and underpins the rapid advances in AI. At the heart of modern HPC platforms is the Graphics Processing Unit (GPU), which delivers the bulk of compute power but also dominates energy consumption. As GPU architectures increasingly prioritize low-precision arithmetic for AI workloads, HPC applications that depend on higher precision face new programmability challenges alongside new opportunities in mixed-precision computing.
Crucially, the energy efficiency of GPU applications depends not only on compute utilization but also on memory traffic patterns, and the fastest implementation is not always the most energy efficient. Reliable exploration of these trade-offs is further complicated by the limited accuracy and temporal resolution of current power measurement tools. Combined with the vast, discontinuous design spaces inherent to GPU programming, manual optimization is infeasible.
Automatic performance tuning, or auto-tuning, offers a proven approach to this problem, automatically searching for optimal configurations across algorithm, application, and hardware parameters. To address the emerging demands of mixed-precision computing and energy-aware execution, the field is now moving toward constrained and multi-objective optimization to enable systematic exploration of the trade-offs between performance, energy consumption, and numerical accuracy. In this talk, I will highlight key challenges, recent developments, and future directions in GPU auto-tuning.
Mitigation starts by treating technical debt and digital waste as sustainability problems. Idle compute, chatty microservices, oversized payloads, unbounded concurrency, always-on resilience, and forgotten data, environments, or duplicate workflows all become permanent excess: more kilowatt-hours, more emissions, more cloud spend.
We uncover where energy is wasted in everyday systems, from CPU boost events with no user value and I/O waits misread as CPU issues to zombie instances and hidden digital waste across storage, pipelines, and tooling.
These findings become a green debt backlog tied to measurable reductions in energy, cost, and operational heat.
The talk reframes performance as value per watt. It explores event-driven designs, lean data contracts, carbon-aware compute placement, and CI/CD checks for efficiency.
Attendees leave with practical habits to mitigate waste, innovate greener systems, and sustain gains long after the conference.
The proposed ISIS-II Neutron and Muon Source underwent a Life Cycle Assessment (LCA) during the early feasibility and design stage. The potential environmental impacts were evaluated across construction, operation, and decommissioning to identify and integrate environmental sustainability practises from its inception.
As with most modern accelerators, computing is - and will be - essential for the design and operation of ISIS-II, yet predicting the computing impact for a facility that is proposed to run from 2040 to 2100 comes with its challenges. This work shares those challenges and explores the assumptions made to attempt to predict the required computing resources of a future accelerator.
In many science and engineering disciplines, limited representative training data, poor reproducibility and low interpretability hinder the complete integration of AI. The environmental impact of this growing technology is also of particular concern. Physics-informed machine learning (PIML) seeks to answer the aforementioned challenges, with many techniques leveraging physical knowledge to reduce training data requirements. We aim to explore how and when these approaches reduce model emissions.
In this initial work, we embed physical insight into our ML models, assessing performance and emissions jointly on two simple benchmarks, one synthetic and one from an engineering lab experiment. The work demonstrates how a PIML approach can reduce emissions based on reduced training data, yet also highlights the increased model complexity from additional hyperparameters to be optimised, and the tradeoff between these factors to decrease overall emissions.
The Department of Aeronautics at Imperial College London is addressing the environmental and accessibility challenges of modern research by deploying a scalable repository architecture. This system integrates a custom InvenioRDM interface with Ceph object storage to manage massive computational datasets in alignment with FAIR principles. By leveraging software-defined storage on commodity hardware, the department avoids carbon-intensive "forklift upgrades," allowing for sustainable, incremental capacity growth.
The infrastructure features a self-healing, S3-compatible backend designed to eliminate "dark data" through domain-specific metadata curation. To reduce energy consumption associated with unnecessary network egress, the platform supports flexible retrieval, enabling researchers to inspect granular data subsets rather than downloading entire multi-terabyte files. Ultimately, this ecosystem prevents redundant, energy-heavy re-computations by transforming primary data into a permanent, reusable asset. The proposed talk details the lifecycle of this transition from ad-hoc management to an integrated, environmentally conscious research framework.
Astronomers have a unique perspective on the Earth, its fragility, and the absence of a 'planet B'. Yet the carbon footprint of their activities and instruments remains substantial. The amount of data generated by these increasingly precise technical instruments, and the subsequent computing infrastructure needed to process and store it, poses a key challenge to sustainability.
The Wide-field Spectroscopic Telescope (WST) is a 12-meter spectroscopic facility currently under development and potentially operational in Chile in 2040. One of its key science cases is the so-called 'time domain astrophysics', which requires rapid follow-up observations of transient sources in the night sky. The WST will be equipped with a provisional number of ~600 detectors, which will gather data continuously every night over an expected lifetime of 50 years. The expected data volume ranges from 1 to 3 PB per year.
In this talk, we will present the first estimates of the carbon footprint associated with the data reduction pipeline and storage infrastructures. We will highlight the WST's ongoing effort to incorporate sustainability considerations into hardware selection for data processing and storage, and explore how location affects the carbon footprint of the different solutions. We will also discuss how integrating sustainability early in the design process of research infrastructures can effectively mitigate the environmental impact.
Time- and location-shifting of computational workloads is widely proposed to reduce data-centre emissions by exploiting variation in electricity carbon intensity. However, CO$_2$-only optimization can shift burdens to places where impacts are experienced locally, such as water withdrawals in stressed basins, worsened air-pollution exposure, and increased stress on constrained grids. We present Orca, a sustainability-aware workload shifting framework that jointly considers global climate impacts and heterogeneous local criteria. Orca integrates region- and time-dependent signals for carbon, water-stress--weighted water use, air-pollution exposure proxies, and grid-stress indicators, and formulates scheduling as a multi-objective optimization problem. Using Pareto analysis, preference weighting, and optional impact caps, Orca exposes and mitigates trade-offs between emissions reduction and local burdens. A three-region case study shows that CO$_2$-optimal shifting can worsen local outcomes, while Orca produces context-sensitive schedules that better balance global and local sustainability objectives.
Sustainability and software engineering are often treated as separate concerns. They do intersect. One often focuses on energy, carbon, and environmental limits. The other focuses on code, systems, longevity, reproducibility, and delivery.
This talk asks if the link runs deeper. Both fields face similar pressures. Demand rises. Resources are finite. Complexity grows. Hidden costs accumulate. I draw on work in network systems, media, broadcasting, open source, mentoring, platform-scale systems, and research computing.
If so, better software engineering is not merely adjacent to sustainability. The two can be symbiotic.
Through projects and examples, the session explores how to build systems that scale better and waste less. It also asks how systems can create more capable participants. Finally, I consider what opportunities lie beyond net zero, and how we build for that world.