I'm a Data Engineer based in London, UK 🇬🇧, During the day I'm a Data Engineer at a Experian, and in my free time I'm a self-taught Software Engineer.
Projects.
Learning platform for children to learn about Python and coding.
An interactive platform to teach children the fundamentals of coding and that provides details to tutoring club.
A platform to help job seekers track their applications and manage their job search process. Also get help to improve their CV and cover letter.
A personal finance tracker to help you manage your budget and expenses.
Experience.
API Development & Performance Optimisation
- Engineered and deployed a high-performance Python 3 FastAPI service to replace a legacy Python 2 CLI tool for address data correction. Implemented parallel processing with multiple workers, achieving a 3x improvement in performance.
- Developed a Java Spring Boot RESTful API and a serverless Python AWS Lambda (deployed with Terraform) for large-scale data aggregation from a PostgreSQL database with tables containing over a billion records. Optimised query performance by leveraging native database functions to pre-aggregate data, significantly reducing latency.
- Processed and maintained large-scale CAIS/CATO data feeds for credit reporting, ensuring data accuracy and compliance within a high-security environment.
- Built a custom Python API wrapper to interface with third-party C libraries, ensuring seamless integration with an external address validation service.
- Designed and delivered a bespoke, type-safe Python API for a key client, innovatively overcoming the limitations of an older Python 3.6 environment to meet stringent requirements.
Skills.
Languages
PythonEngineered high-performance APIs with FastAPI and serverless solutions using AWS Lambda.
JavaDeveloped robust, enterprise-level APIs using Spring Boot.
JavaScriptConducted rigorous API load testing with k6 to ensure system robustness.
Swift*Developed native iOS applications for personal projects.
Databases
OracleManaged large-scale databases for critical business applications.
PostgreSQLOptimised large-scale data aggregation queries to reduce latency.
Firebase*Utilised Firebase for real-time data synchronisation in web and mobile apps.
MongoDB*Designed and implemented NoSQL databases for flexible data modelling.
DevOps
DockerContainerised applications for reproducible and isolated deployments.
JenkinsArchitected and implemented self-serve CI/CD pipelines.
KubernetesOrchestrated containerised applications for scalable, resilient services.
GitManaged version control for all projects using Git, enabling team collaboration.
TerraformProvisioned and managed cloud infrastructure using Terraform.
Other
PySparkImproved performance of large-scale data transformations with PySpark.
KafkaMaintained Apache Kafka integration in a Java application, consuming and producing messages to topics.
Next.js*Built modern, server-rendered React applications for optimal performance.
React*Developed interactive UIs and dashboards for data visualisation.
ApigeeManaged and secured APIs using Google Cloud's Apigee platform.
* These are skills I've cultivated through personal projects and experiences outside of my professional roles.
My Story.
My journey into the world of data began not in a computer lab, but in a civil engineering classroom. I was fascinated by the power of MATLAB, modeling complex systems and finding elegant solutions to challenging problems. This passion for problem-solving led me to get my first MacBook and dive into the world of programming, starting with iOS development.
The thrill of building something from scratch, of seeing my ideas come to life, was intoxicating. But I soon realized that what truly captivated me was the data that powered these applications. I became obsessed with understanding how data was stored, processed, and leveraged to create meaningful experiences. This newfound passion led me to a career as a Data Engineer at Experian, where I could immerse myself in the world of big data.
I've had the privilege of working with a diverse range of technologies, from relational databases like SQL, Python, Java, and JavaScript, and delving into the world of distributed computing with big data frameworks. I'm proficient in building and maintaining robust CI/CD pipelines using tools like Docker and Jenkins, ensuring that data flows seamlessly and reliably from source to destination.
I'm a firm believer in the power of open source and am always exploring new tools and technologies to expand my skillset. I'm excited to see what the future holds and am always open to new challenges and opportunities.