Data Engineer II, Data & AI Platforms
- Analyzed and optimized cloud costs using AWS tools, identifying cost-saving opportunities and optimizing resource allocation.
- Contributed to the re-architecture of Snowflake's role-based access control (RBAC), executing a complete overhaul through Terraform to enhance data access management.
- Spearheaded the implementation of data masking techniques for personally identifiable information (PII) in Snowflake, fortifying data privacy and compliance.
- Architected and developed a comprehensive data contract pipeline infrastructure, leveraging Lambda functions and Python-based Great Expectations for data validation.
- Pioneered the setup of a Databricks project tailored for data scientists, facilitating advanced machine learning modeling.
- Implemented monitoring and alerting systems using AWS CloudWatch, Splunk, and Datadog, ensuring proactive issue identification, debugging, triage, and resolution.
- Designed and implemented a call transcription pipelineĀ for member calls, streamlining analysis and reporting processes.