Download PDF

Kevin J Clark

Senior Engineering Manager - Cloud Operations and Architecture - Data and ML/AI

    Executive Summary

    Highly experienced Senior Engineering Manager and Architect with a focus on Cloud Data Platform and ML/AI Ops.  Proven track record of successfully migrating legacy systems into Cloud Data Warehouses, resulting in significant additional revenue , substantial cost savings,  and improved security. Has also led the migration of Data Science platforms and the deployment of ML models, generating substantial additional revenue. Extensive experience in selecting and implementing tech stacks for ETL needs, as well as transforming teams into a DevOps/DataOps model. Expertise extends to Data Governance and Data Quality tools, enabling organizations to gain deeper insights into their customer base.. Has designed and implemented custom solutions, saving millions of dollars and ensuring compliance with industry regulations. Contributions to open source projects and his ability to train and mentor teams have been recognized by executive leadership. 

    Professional Experience

    LendingTree
    Aug 2022Current

    Senior Engineering Manager- Cloud Operations and Architecture - Data and AI/ML

    • Successfully led the migration of legacy EDW and RMDBS systems into Snowflake (AWS), resulting in a cost savings of over eight (8) million dollars over a three-year period. Additionally, improved security landscape and time to market by 60% compared to legacy systems.
    • Spearheaded the migration of the Data Science platform from AWS (Spark EMR) to Snowpark ML, enabling the deployment of over ten (10) ML models for near real-time inference. This initiative generated over 3.5 million dollars in additional revenue in two years. Real-time models were deployed to AWS Sagemaker.
    • Conducted formal POCs to select the tech stack for ETL needs, resulting in the adoption of DBT for transformation and Data Vault modeling, Apache Airflow (Astronomer) for orchestration and scheduling, FiveTran and Confluent Kafka for data movement, and Snowflake for the Data Warehouse.
    • Transformed existing Data Engineering and Platform teams into a DevOps/DataOps model, providing training sessions on GitOps and migrating all pipelines into GitLab. This reduced reliance on external DevOps and support teams by over 90% and increased the velocity of deliverables by over 75%.
    • Assisted the Data Governance team in rolling out Data Governance (Collibra) and Data Quality (Soda Cloud) tools using AWS EKS edge components developed by our team. These pipelines leveraged CICD and API integration, allowing for a deeper understanding of the customer base and improving deliverables for the organization.
    • Implemented tooling for AIOps/ MLOps using Apache Airflow , Snowpark ML API’s, DBT, and Snowflake Cortex models to roll out near real time capabilities for call center sentiment analysis. This effort was a 600K cost savings effort for the organization.
    • Was primary architect for setting up reference architecture for LendingTree’s front end lead generation offers platform , and the introduction of ML algorithms into the platform. This was an extensive design review that utilized many changes on the web platform itself, and  exposed additional API’s that allowed MLOps pipelines to interact with the platform. The initial lift for the organization was 1.3 million dollars in additional revenue for the first quarter this was instrumented. 
    • Developed custom Snowflake RBAC model using Terraform, Azure AD SCIM API’s , and Snowflake REST API’s to improve our security posture by having all roles automated and Auto Classification tags applied on the fly. This effort allowed moving our 3 FTE’s who was doing this as manual work and re-train them into DataOps engineers to work on MLOps and Data Engineering pipelines. 
    Ally
    Dec 2019Aug 2022

    Enterprise Analytics- Cloud Platform Engineering and DevOps Manager

    • Led the successful transition of the Ally Data Platform organization to the Ally public cloud, training over 20 legacy Big Data engineers on the necessary skills to shift left. Accomplished this without additional time or budget, enabling the migration of Analytics and Data Science teams to the cloud within six months.
    • Designed and implemented a DevSecOps pipeline, facilitating the secure and reliable transfer of over 500TB of data into AWS. This established the Ally Enterprise Data Lake and populated the Snowflake environment, resulting in significant revenue gains for the company.
    • Developed a custom Kerberos-enabled AWS EMR module using Terraform, enabling Ally Financial Data Science teams to run complex Spark workloads securely and cost-effectively in the cloud. This initiative saved Ally millions of dollars and ensured compliance with federal mandates.
    • Created a custom Apache open-source ETL tool for all ETL needs in the Ally Public Cloud. This tool is widely used across the organization and has been recognized as a cost-saving solution, eliminating the need for vendor licensing and support.
    • Selected as a member of the Ally Public Cloud steering committee, contributing to the design and implementation of the public cloud strategy. This committee consists of executive leadership and thought leaders, highlighting the recognition of expertise and contributions.
    • Collaborated with other teams within Ally to accelerate their transition to the cloud, serving as a training resource and exemplifying a successful shift-left initiative. This initiative will result in significant cost savings for Ally in training expenses in 2022.
    • Spearheaded the successful migration of the Ally Data Platform organization to the Ally public cloud, training and upskilling a team of 20 legacy Big Data engineers. This transition was completed within six months, enabling the Analytics and Data Science teams to leverage the cloud's capabilities effectively.
    • Implemented a robust DevSecOps pipeline, ensuring the secure and efficient transfer of over 500TB of data into AWS. This initiative established the Ally Enterprise Data Lake and Snowflake environment, resulting in substantial revenue gains for the company.
    • Developed a custom Kerberos-enabled AWS EMR module using Terraform, enabling secure and cost-effective execution of complex Spark workloads in the cloud. This solution saved Ally millions of dollars and ensured compliance with federal regulations.
    • Created a proprietary Apache open-source ETL tool for all ETL requirements in the Ally Public Cloud. This tool has been widely adopted across the organization, eliminating the need for vendor licensing and support and resulting in significant cost savings.
    • Appointed as a member of the Ally Public Cloud steering committee, contributing to the development and implementation of the public cloud strategy. This recognition highlights expertise and leadership in cloud technology.
    • Collaborated with various teams within Ally to facilitate their transition to the cloud, providing training and support as a subject matter expert. This initiative will lead to substantial cost savings for Ally in training expenses in 2022.
    Kohls Department Stores
    Aug 2011September 2019

    Solutions Architect - Big Data/ Cloud

    • Led the infrastructure architecture for a high-performance streaming application at Kohls Department Stores, processing over one million messages per second in real-time and integrating with an ML/AI driven backend at Google Cloud.
    • Implemented cutting-edge technologies such as Apache NiFi, Apache Kafka, Apache Beam, ElasticSearch, Google DataFlow, BigTable, and BigQuery, enabling real-time tracking of security events across the entire organization and resulting in annual cost savings of two million dollars.
    • Spearheaded the conversion of the on-prem HortonWorks platform into an Agile/Lean model, establishing TCO-based metrics using open-source tooling and implementing an infrastructure-as-code DevOps model, leading to total cost savings of over six million dollars and the sunset of a data center.
    • Led the security architecture efforts to ensure PCI and PII compliance for Kohls' Big Data assets, successfully rolling out a secure platform in both the Google Cloud and on-premises environments, resulting in cost savings of over ten million dollars over a projected five-year period.
    • Established and led the Kohls Big Data performance team, responsible for testing large data sets and jobs in both the Google Cloud and on-premises environments. Developed scripts for testing complex applications, enabling a smooth transition to the Cloud and saving the company millions of dollars.
    • Played a key role in the initial Big Data team at Kohls, responsible for vendor selection, installation, and testing of the HortonWorks platform. Collaborated with application teams to integrate the platform into the recommendation engine for kohls.com, driving significant revenue growth.
    • Maintained consistency in formatting and tense usage throughout the work-history section, ensuring a professional and polished presentation.
    • Proofread all points to eliminate grammatical errors and typos, ensuring a flawless and error-free section.
    West Bend Mutual Insurance
    Apr 2009Mar 2011

    Senior Solutions Engineer

    • Led the architecture and development of the WBMI ESB (Enterprise Service Bus) platform, creating data models and integration patterns for web services applications. This innovative hub enabled the consolidation of over eight applications, resulting in a cost savings of 800K over a two-year period.
    • Implemented ESB and messaging security measures for the new hub, ensuring compliance with security mandates from the organization and third-party partners. This compliance facilitated data sharing between WBMI and three additional partners, generating significant revenue for the organization.
    • Served as the technical lead for disaster recovery programs, overseeing the implementation of comprehensive plans for global initiatives. This included not only the web services hub but the entire infrastructure, ensuring compliance with business continuity requirements.
    • Collaborated with cross-functional teams to ensure seamless integration and functionality of the ESB platform, providing technical guidance and support throughout the development and implementation process.
    • Maintained clear and concise documentation of architectural designs, integration patterns, and disaster recovery plans, facilitating ease of understanding and knowledge transfer within the organization.
    • Communicated complex technical concepts and requirements to stakeholders in a clear and concise manner, ensuring alignment and understanding across teams.
    • Consistently adhered to industry best practices and standards, ensuring the reliability, scalability, and security of the ESB platform and related systems.
    • Conducted regular audits and assessments to identify areas for improvement and implemented necessary enhancements to optimize performance and mitigate risks.
    Wachovia / Wells Fargo Bank
    Aug 2001Apr 2009

    AVP - Manager of Common Services

    • Led a three-year effort to select and implement Vignette as the content management platform provider for Wachovia's home page, ensuring compliance with SLAs and design objectives.
    • Collaborated with design, technical, and business teams to ensure the home page met all necessary requirements and facilitated seamless online banking operations, including brokerage and bill-pay services.
    • Managed Wachovia's single sign-on application, utilizing RSA-based technology to enhance customer experience and ensure compliance with SOX and other regulatory agencies, resulting in significant cost savings and improved business continuity.
    • Led the design and implementation of a secure messaging platform in the Wachovia DMZ, enabling secure data exchange with other banks and third parties, generating substantial revenue streams for the business units.
    • Successfully implemented the federal program Check 21, allowing online check images to become a reality at Wachovia, streamlining check processing and enhancing customer convenience.
    • Managed the onboarding process for new employees and onshore/offshore contractors, overseeing a yearly budget and conducting performance reviews for a team of over 15 direct reports.
    • Maintained consistent communication and conducted weekly team meetings to ensure alignment, foster collaboration, and drive team performance.
    • Consistently utilized action-oriented language to describe responsibilities and achievements, highlighting the impact and value of my contributions.
    • Quantified achievements where possible, such as cost savings, revenue generation, and team size, to provide a clearer picture of my capabilities.
    • Ensured clarity and specificity in describing responsibilities and achievements, avoiding generic or vague descriptions.
    • Maintained consistency in formatting, tense usage, and overall style throughout the section, enhancing professionalism and readability.
    • Proofread all points carefully to ensure they were error-free and conveyed the intended message accurately.

    Education

    University of Wisconsin - Whitewater

    Management Information Services/ Business

    University of Wisconsin- Milwaukee

    Biological Sciences

    Technology Skills

    DevOps : Jenkins , Git, Ansible, Terraform, Python, Bash, Gitlab, Kubernetes, OpenShift 

    SRE : OpenTSDB, Grafana, Prometheus, Cavisson, Google Stackdriver, Apache Airflow, Azkaban, App Dynamics

    BigData :  Kafka, Spark, MR, HDFS, Yarn, Hive, NiFi, Beam, Protegrity, Rstudio , Confluent Cloud, FiveTran, Snowpark ML

    SQL: Oracle, MySQL, DB2, Snowflake

    No SQL : HBase, Cassandra, ElasticSearch , Redis,  DynamoDB,  

    Cloud - Google: DataProc, BigTable, BigQuery, DataFlow , GKE ( Kubernetes) , GCE,  Google Load Balancing, Cloud Pub/ Sub 

    Cloud- AWS : EC2, S3, EMR, , DynamoDB, AWS Lake Formation, EKS, IAM, Fargate,  Sagemaker, Lambda, Kinesis, AWS Managed Airflow

    Misc : IBM MQSeries, IBM Websphere, Apache HTTP Server, Tomcat, Sonic ESB, Sonic MQ, Spring Boot