Skip to content

VSN-1041/Connect to FTP server and fetch daily JSON files by date

Oumayma Rahabat a demandé de fusionner feature/VSN-1041 vers develop
  • Clean raw data using pandas: remove duplicates and invalid immatriculations
  • Transform data to fit geoloc service schema (deviceId, carRegistration, trips, points)
  • Add centralized logging with info/warning/error levels
  • Schedule ETL execution daily at 4 AM (Paris time) via APScheduler
  • Externalize config via .env file for secure FTP and scheduling settings
  • Prepare for API call to Spring Boot geolocation service for data insertion

Rapports de requête de fusion