Skip to content
  • Oumayma Rahabat's avatar
    - Connect to FTP server and fetch daily JSON files by date · 2892956c
    Oumayma Rahabat a rédigé
    - Clean raw data using pandas: remove duplicates and invalid immatriculations
    - Transform data to fit geoloc service schema (deviceId, carRegistration, trips, points)
    - Add centralized logging with info/warning/error levels
    - Schedule ETL execution daily at 4 AM (Paris time) via APScheduler
    - Externalize config via .env file for secure FTP and scheduling settings
    - Prepare for API call to Spring Boot geolocation service for data insertion
    2892956c