Skip to content

Commit

Permalink
Merge remote-tracking branch 'origin/main' into clim-recal-download-p…
Browse files Browse the repository at this point in the history
…age-link
  • Loading branch information
sgreenbury committed Jul 10, 2024
2 parents 1fdbf22 + 7152626 commit 1c103ed
Show file tree
Hide file tree
Showing 3 changed files with 24 additions and 11 deletions.
Binary file added public/blog_content/v2_release/acbm_diagram.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified public/blog_content/v2_release/popgetter.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
35 changes: 24 additions & 11 deletions src/content/blogs/platform_v2.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,12 +7,23 @@ authors:
- sam_greenbury
- dustin_carlino
- anna_zanchetta
publish_date: 2024-05-08
- penelope_yong
- griffith_rees
- andy_smith
- bowen_zhang

publish_date: 2024-07-10
projects:
- popgetter
- clim_recal
- demoland
- spc
tags:
- release
- platform
image:
url: https://www.enterpriseai.news/wp-content/uploads/2022/08/geospatial-data_shutterstock-2078842243_900x-370x290.jpg
alt: Some GEOAI image

summary: Debiased climate projections for cities, geospatial chatbots, a speedier SPC and so much more! Learn about what's new in the Urban Analytics Technology Platform
---
Expand Down Expand Up @@ -116,22 +127,24 @@ Your browser does not support the video tag.

We think these templates are a good starting point for anyone who might be interested in building urban analytics applications and so we are making them available to the wider community to use and improve on.

The template source code is available on [GitHub](https://github.com/Urban-Analytics-Technology-Platform/web-app-template), but you can get started more quickly by running in your terminal: **npm create @uatp/web@latest**
The template source code is available on [GitHub](https://github.com/Urban-Analytics-Technology-Platform/web-app-template), but you can get started more quickly by running in your terminal:

```shell
npm create @uatp/web@latest
```

As part of this work, we have been helping build some features upstream into the [svelte-maplibre](https://svelte-maplibre.vercel.app/) library that powers our maps. It's a great project that we have loved contributing to.

#### New ways to access SPC

<!-- TODO: potentially add diagram for SPC toolkit -->

The Synthetic Population Catalyst (SPC) ([paper](https://doi.org/10.1177/23998083231203066), [website](https://alan-turing-institute.github.io/uatk-spc/), [github](https://github.com/alan-turing-institute/uatk-spc)) provides a synthetic population of individuals and households for Great Britain (GB), including socio-demographic, income, health, and daily activity features, as well as future populations through projections.

To make it easier to work with SPC outputs, we have added two new features:

- **Parquet outputs**: we've included new serializers to enable output in columnar [parquet](https://parquet.apache.org/) format. Parquet is designed to efficiently deserialize into the efficient Arrow memory layout. As an example, for West Yorkshire, peak memory usage and time-to-load drop from 11GB and 6 minutes down to 2GB and 2 seconds working with the new parquet output, as well as enabling previously challenging areas to load (such as Greater London), to be loadable in 10-20 seconds.
- **[SPC toolkit (`uatk_spc`)](https://github.com/alan-turing-institute/uatk-spc/tree/main/python)**: we created a new Python package that simplifies reading and working with SPC outputs. You can now read protobuf or parquet populations directly from local file paths or a URL, as well as build dataframes from the fields of the population to produce customised datasets as needed.
- **[SPC toolkit (`uatk_spc`)](https://github.com/alan-turing-institute/uatk-spc/tree/main/python#readme)**: we created a new Python package that simplifies reading and working with SPC outputs. You can now read protobuf or parquet populations directly from local file paths or a URL, as well as build dataframes from the fields of the population to produce customised datasets as needed.

Further [documentation](https://alan-turing-institute.github.io/uatk-spc/using_use_output.html#python) and [example notebooks](https://github.com/alan-turing-institute/uatk-spc/tree/main/python/examples) demonstrate the new features and show how the SPC toolkit can be used to read and build populations for data science and machine learning analyses.
Further [documentation](https://alan-turing-institute.github.io/uatk-spc/using_use_output.html#python) and [example notebooks](https://github.com/alan-turing-institute/uatk-spc/tree/main/python/examples) demonstrate the new features and show how the SPC toolkit can be used to read and build populations for data science and machine learning analyses. Please reach out and [open an issue](https://github.com/alan-turing-institute/uatk-spc/issues) if there are improvements or new features you would like to see in the SPC toolkit!

#### New tools for working with GeoJSON

Expand Down Expand Up @@ -159,7 +172,7 @@ For more details on these exciting developments, see this [recent blog](https://
Demoland is our prototype tool for exploring the strategic trade-offs that come with land use planning decisions. Built in collaboration with the Geospatial Commission and Newcastle City Council, it allows users to change land use signatures and see the predicted impact of those changes on four quality of life metrics (house prices, access to jobs, access to greenspace, and air quality).

Though initally built for Newcastle, we have been hard at work developing a pipeline that allows us to spin up a Demoland app for any part of the UK. You can check out a version of the app
for the Isle of White running [here](https://urban-analytics-technology-platform.github.io/demoland-web/dev/isle_of_wight/). If you are interested in running Demoland for your local area, reach out to us to let us know. You might also notice another new feature in this demo: hex bin geographies. Now users can choose between the Urban Grammar geometries that were part of the original Demoland and the hex bin geometries you can see here.
for the Isle of Wight running [here](https://urban-analytics-technology-platform.github.io/demoland-web/dev/isle_of_wight/). If you are interested in running Demoland for your local area, reach out to us to let us know. You might also notice another new feature in this demo: hex bin geographies. Now users can choose between the Urban Grammar geometries that were part of the original Demoland and the hex bin geometries you can see here.

Users can now also generate their own scenarios, see the impacts of those scenarios, and share them with others.

Expand Down Expand Up @@ -193,25 +206,25 @@ More on this to come in an upcoming related blog post.

#### Making SPENSER faster

Building on [SPENSER](https://www.turing.ac.uk/research/research-projects/synthetic-population-estimation-and-scenario-projection), in the UATP [microsimulation](https://github.com/Urban-Analytics-Technology-Plarform/microsimulation) fork, we have re-implemented part of the model to enable faster runtime, while maintaining the same underlying algorithm to enable it to be used as a drop-in substitute.
Building on [SPENSER](https://www.turing.ac.uk/research/research-projects/synthetic-population-estimation-and-scenario-projection), in the UATP [microsimulation](https://github.com/Urban-Analytics-Technology-Platform/microsimulation) fork, we have re-implemented part of the model to enable faster runtime, while maintaining the same underlying algorithm to enable it to be used as a drop-in substitute.

With improved performance, the work aims to facilitate the generation of ensembles of populations for uncertainty and scenario modelling, for example, for use as a base population for the [Synthetic Population Catalyst](https://github.com/alan-turing-institute/uatk-spc).

For further details, a quickstart guide, and benchmarks, see the [README.md](https://github.com/Urban-Analytics-Technology-Platform/microsimulation/blob/main/microsimulation-rs/README.md) introducing `microsimulation-rs`.
For further details, a quickstart guide, and benchmarks, see the [README.md](https://github.com/Urban-Analytics-Technology-Platform/microsimulation/tree/dev/microsimulation-rs#readme) introducing `microsimulation-rs`.

---

### What's next

#### Activity-based model (AcBM) for SPC

<!-- TODO: add diagram for AcBM -->
![acbm_diagram](/blog_content/v2_release/acbm_diagram.png)

The SPC described [above](#new-ways-to-access-spc) in our update with the new [SPC toolkit](https://github.com/alan-turing-institute/uatk-spc/tree/main/python) includes daily diaries for capturing how people spend their time, e.g. proportion of time at work, school, or retail venues. However, more fine-grained detail about both the order in which they complete their daily activities and how they complete them (e.g. car, walk, bus) is missing. Understanding this can help us better understand how people spend their time, which can be useful for a wide range of applications such as transport demand modelling.

As such, we are developing the [Activity-based Model(AcBM)](https://github.com/Urban-Analytics-Technology-Platform/acbm), a pipeline aiming to extend the [Synthetic Population Catalyst (SPC)](https://github.com/alan-turing-institute/uatk-spc) for transport demand models. It will combine the [National Travel Survey (NTS)](https://www.gov.uk/government/collections/national-travel-survey-statistics) with SPC population members through matching and then assign venues for the activities in schedules from the NTS to derive spatial trajectories associated with schedules for individuals.

For more details, check out the [AcBM documentation](https://github.com/Urban-Analytics-Technology-Platform/acbm).
For more details, check out the [AcBM documentation](https://github.com/Urban-Analytics-Technology-Platform/acbm/wiki).

#### LLM toolkit

Expand Down

0 comments on commit 1c103ed

Please sign in to comment.