Data Processing

Client: Government Category: Data Processing Year: 2024 Project Monitoring Software: MS Access, MS Excel Database: Access, SQL Server Programming: Python (Pandas, Sci-kit Learn, Beautiful Soup), VBA Objectives Automate the collection and storage of Google Alerts for monitoring published articles online. Enhance data quality through formatting, cleaning, and machine learning-based filtering.

Client: Government Category: Data Processing Year: 2022 Dataflow Pipeline Software: DataBricks, MS Excel Database: MS Azure, National Reporting System Programming: Python (PySpark) Objectives Automate data ingestion from external databases via a national reporting system. Streamline data processing for near real-time analytics and reporting. Leverage API to aggregate and integrate data.