Export CSV function exceeds memory limit

[davidgamez]

Describe the bug

The execution of the export CSV function exceeds the assigned memory limit in PROD.

Related to: #888

Steps/Code to Reproduce

• Execute the export.csv function in the prod

Expected Results

• Function completes and generates the CSV file at https://files.mobilitydatabase.org/sources_v2.csv

Actual Results

• The function fails with error in the logs

Memory limit of 1024 MiB exceeded with 1028 MiB used. Consider increasing the memory limit.....

Screenshots

No response

Files used

No response

Additional notes

I increased the memory to 2GB and got the function running. However, this solution is not permanent, as the feed and dataset counts will continue to grow exponentially.