Software Engineer
BAE Systems Applied Intelligence, London
July 2016 - July 2021
Technology stack includes Python, Elasticsearch, Hadoop, SAS, Linux to deliver various projects
Experience
I have been involved in various client-side software engineering projects through my employment. I completed a bespoke training academy covering Object-Oriented design, Java Enterprise, Testing processes, and software lifecycles. Which resulted in multiple professional certifications including Oracle Certified Associate - Java SE 7 Programmer
Project 0 - Due to COVID-19 our forward deployed software development team, moved to remote working. Our team moved to further develop a bespoke capability for Project 2. The capability provides an end to end data pipeline solution for data ingestion, extraction, and statistical analysis. I produced software designs on how the transfer of data between micro services would be implemented and POC using Kafka. Contributed to complex design designs, Performed code reviews across the repositories, Created CI/CD pipelines, Presented progress of the MVP to the client.
Project 1 - Selected to be part of a small team to provide Cloud based Data Engineering capabilities for the COVID-19 response. I worked with a range of API’s and data access points to automate the data ingest process to provide up to date data for the the data scientist and data analysts. Using AWS products such as S3, Lambda, and CloudWatch. Also using processes such as Infrastructure-as-code to create repeatable deployment pipelines.
Project 2 - As part of the forward deployed software development team, working closely with stakeholders to understand their data holdings and turn it into actionable decisions. Day to day tasks include working with a range of data formats, building reusable data pipelines to transform and standardise data into a conformed schema, data exploration for data quality issues and schema discovery. As well as building a tool to monitor data landing, a script to check the integrity of Parquet files in transit, building small web apps to help analysts to complete mundane tasks quickly.
Project 3 - Working within a sward of four software developers using agile methodologies to deliver and support a bespoke mission critical data analysis framework which turns a daily stream of ~1TB of raw data into rich valuable data through manipulation and enrichments for our analysts. The framework consists of python micro-services, Object orientated component’s, web services using Flask, Behaviour driven development, Unit and integration testing, and version control.Using jira to plan sprints, confluence to document code and record retrospectives.
Key Achievements
Delivering mission critical bespoke software engineering projects.
Communicate with Management, Stakeholders, and end users directly to understand requirements, issues and steps forward. Which resulted in winning the trust of clients and strengthening the company relationship.
Leading and mentoring Interns and junior staff.
Co-leading a team to deliver software on time.
Working with agile methodologies to deliver iterative project updates.