Process Activity
Description: Ingest and prepare data from EEA Air Quality
Diagram of the Process Activity
digraph Diagram { graph [ stylesheet="../_static/custom.css" fontnames = "svg" # "... rock solid standards compliant SVG", see: https://graphviz.org/faq/font/#what-about-svg-fonts rankdir="LR" nodesep="0.15" tooltip=" " ]; node [ fontname="sans-serif" ]; activity_a142bdc5_8e35_4de1_94f6_c3a1e298ed79 [ shape="rect" style="filled, rounded" width="3" height="0.8" fontcolor="white" fillcolor="#4363d8" fontsize="13pt" label="EEA Air Quality\n(current activity)" tooltip=" " ]; EntityUsed_1 [ shape="rect" style="filled" width="2" height="0.1" fontcolor="blue" fontsize="10pt" URL="https://discomap.eea.europa.eu/map/fme/AirQualityExport.htm" target="_blank" label="website" tooltip="Entity used for current activity" fillcolor="#ffe119" ]; EntityUsed_1:e -> activity_a142bdc5_8e35_4de1_94f6_c3a1e298ed79:w [ minlen="2" ]; }
Diagram of the Process Sub-Activities (in sequential order)
Note
Click on a sub-activity to go to the corresponding page.
digraph Diagram { graph [ stylesheet="../_static/custom.css" fontnames = "svg" # "... rock solid standards compliant SVG", see: https://graphviz.org/faq/font/#what-about-svg-fonts rankdir="LR" tooltip=" " ]; node [ fontname="sans-serif" ]; subgraph { rank="same"; activity_6a8934ad_b0c7_4a2c_8899_129ce9e9b4a3 [ label="EEA Get raw input" shape="rect" style="filled, rounded" width="3" fontcolor="white" fillcolor="#4363d8" URL="../activity_6a8934ad-b0c7-4a2c-8899-129ce9e9b4a3.html" target="_parent" tooltip=" \nGo to process activity" ]; activity_d79858ab_3d27_48d2_ba6a_64f37b7dd06d [ label="EEA Marshalling data" shape="rect" style="filled, rounded" width="3" fontcolor="white" fillcolor="#4363d8" URL="../activity_d79858ab-3d27-48d2-ba6a-64f37b7dd06d.html" target="_parent" tooltip=" \nGo to process activity" ]; activity_c6b1e1d8_2e41_441c_83a7_3e809d7a07db [ label="EEA Data Processing" shape="rect" style="filled, rounded" width="3" fontcolor="white" fillcolor="#4363d8" URL="../activity_c6b1e1d8-2e41-441c-83a7-3e809d7a07db.html" target="_parent" tooltip=" \nGo to process activity" ]; } subgraph { rank="same"; activity_6a8934ad_b0c7_4a2c_8899_129ce9e9b4a3_Description [ label="The process involves obtaining a list of stations with GPS coordinates from\la pan-European metadata CSV file and selecting specific stations based on\ltheir GPS coordinates and ID. Only background stations are selected. The\lNUTS regions, defined by their GPS coordinates for polygons, are taken into\laccount when the data is collected.\l" tooltip=" \nDescription of activity" shape="note" width="5" height="0.1" color="grey" fontsize="10pt" ]; activity_d79858ab_3d27_48d2_ba6a_64f37b7dd06d_Description [ label="All the collected data, including pollutant-by-station-by-hour information,\lis consolidated into a single file named \"eea-stations,\" with each row\lrepresenting a specific pollutant, station, and hour. The merged data is\lstored in Parquet format, serving as a checkpoint for external reviewers to\lvalidate the analysis.\l" tooltip=" \nDescription of activity" shape="note" width="5" height="0.1" color="grey" fontsize="10pt" ]; activity_c6b1e1d8_2e41_441c_83a7_3e809d7a07db_Description [ label="The process involves collapsing the data on time to group it by day, using\lmaximum values. It is then collapsed by region, also using the maximum\lvalue for each region. Index variables are calculated based on the\lconcentrations provided by the EEA. These index variables help create a\lclassification of air quality (e.g., Good, Fair, Moderate) are based on the\lEuropean Air Quality Index as of August 2023. Derived variables are\lcomputed to determine the worst quality and the number of days with poor\lquality for different time periods, with specific dates serving as\lreference points. The resulting data is stored as a file, which can be of a\lsuitable format based on the size requirements.\l" tooltip=" \nDescription of activity" shape="note" width="5" height="0.1" color="grey" fontsize="10pt" ]; } activity_6a8934ad_b0c7_4a2c_8899_129ce9e9b4a3 -> activity_6a8934ad_b0c7_4a2c_8899_129ce9e9b4a3_Description [ style="dotted" arrowhead="none" color="grey" ]; activity_d79858ab_3d27_48d2_ba6a_64f37b7dd06d -> activity_d79858ab_3d27_48d2_ba6a_64f37b7dd06d_Description [ style="dotted" arrowhead="none" color="grey" ]; activity_c6b1e1d8_2e41_441c_83a7_3e809d7a07db -> activity_c6b1e1d8_2e41_441c_83a7_3e809d7a07db_Description [ style="dotted" arrowhead="none" color="grey" ]; activity_6a8934ad_b0c7_4a2c_8899_129ce9e9b4a3 -> activity_d79858ab_3d27_48d2_ba6a_64f37b7dd06d activity_d79858ab_3d27_48d2_ba6a_64f37b7dd06d -> activity_c6b1e1d8_2e41_441c_83a7_3e809d7a07db }
