From 50283b088548352e98f97dd5ff4072019c327c69 Mon Sep 17 00:00:00 2001 From: cacoco Date: Fri, 22 Mar 2024 05:35:56 +0000 Subject: [PATCH] deploy: b10105db8e5534f5a4f5008054f90fd044dae088 --- index.html | 2 +- resume/index.html | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/index.html b/index.html index f81dc38..d14ad62 100644 --- a/index.html +++ b/index.html @@ -1,4 +1,4 @@ - +

life and code. in small doses.

Writings and code from a programmer.

For more information on my background and experience, please see the about section.

Foggy City

Published February 3, 2023 #san francisco diff --git a/resume/index.html b/resume/index.html index 345836a..e535d5a 100644 --- a/resume/index.html +++ b/resume/index.html @@ -1,5 +1,5 @@ Resume -

avatar

Christopher Coco
Principal Software Engineer

About

I like to build scalable things.

And drink coffee.

I am a Principal Software Engineer with many years of experience specializing in Distributed Systems, Platform Infrastructure, API Frameworks & Design, and Open Source Software located in San Francisco, CA. I pride myself on mentorship and enjoy the feeling of accomplishment from helping others realize they belong.

Work Experience

Verrus
San Francisco Bay Area, CA
November 2023 - Present
Principal Engineer, Software Infrastructure Lead
Leading infrastructure development at Verrus.
Personal goal pursuit
San Francisco Bay Area, CA
November 2022 - November 2023
Career Break
I am currently focused on being a stay-at-home Dad to my young children.
Twitter
San Francisco, CA
October 2012 – November 2022
Sr. Staff Software Engineer
Software engineer working at a Principal level across the company, primarily in the Platform (infrastructure) organization. Throughout my time at Twitter and in my various roles, I have actively focused on making a positive impact, including:

@Blackbirds Employee Resource Group Lead [2015-2016].

Volunteer and volunteer coordinator - Tenderloin Technology Lab at St. Anthony's [2012 - 2016].

Twitter Engineering Mentor Program, New Hire & Intern mentor.

Twitter Open Source Shepherd and Technical Design Shepherd for many infrastructure and product projects.

Founding member of Engineering Interview Process standardization ("Luna" Process) and founding interview shepherd (+1 reviewer model). Luna Process course instructor for new hires.

Multiple-time attendee to conferences for recruiting and candidate interviewing on behalf of multiple teams (Tapia, NSBE, Grace Hopper) [1] [2] [3] [4] [5] [6] [7].

Twitter Earlybird Camp interviewer, mentor & judge, Twitter #FirstFlight interviewer, panelist & Twitter Academy cultural mentor.

Introduction to Finatra course instructor.

Open source at Twitter course material reviewer and instructor.

Mentor for multiple University of San Francisco Computer Science Capstone Projects [2018]

Member of the Twitter Technical Architecture Group (TAG).

Co-chair, member, and multiple working group leader of the Platform Infrastructure senior IC Group (Platforum).

Member of the Twitter Engineering Migrations Working Group (MWG); helped plan, execute, and track technology migrations across engineering.

Constant cross-team work to improve Developer Experience and increase developer productivity.

A recognized leader in the area of JVM logging technologies.

Led various company GDPR initiatives.

Supported thousands of internal and external customers of the Finatra framework; frequent contributor to other teams' projects, and a champion of testing and writing tests.
Twitter
San Francisco, CA
May 2022 – November 2022
Technical Lead - Compute Integrations Team
The Compute organization provided a scalable, efficient, and cost-effective computing platform for all of Twitter. The Compute Integrations Team was responsible for integrating Kubernetes with various Twitter-specific technologies like Service Discovery, application configuration federation, application observability, and chargeback. The team was also fully responsible for the Compute-org-managed Kubernetes clusters in GCP.

Work to optimize service discovery in Kubernetes clusters by moving the service discovery infrastructure in Kubernetes to be regional (in this case per data center) rather than per cluster.

Work to design an automated way of on-premise Kubernetes cluster discovery and registration for better integration into existing Twitter infrastructure and more visibility and introspection into the running clusters.

High-priority work to secure the global package store infrastructure ("Packer"):
 — Java-based Finatra service with a python client. The client is distributed on developer laptops, via the package store for other infrastructure components, e.g. CI/CD components for package retrieval, and via a Linux RPM for data center host management infrastructure services.
 — Work involved updating the server to support both internal mutual-TLS (mTLS) and TLS (in addition to Kerberos) and updating the Python client to ensure it negotiated connections from the various locations of deployment correctly (either mTLS where a client certificate could be presented or via TLS where Kerberos was also in use).
 — A massive undertaking to update all instances of the distributed Python client which involved multiple Puppet runs to release new versions to the data center machines (with minimal documentation and a dwindling number of experts around to ensure that catastrophe was avoided).
Twitter
San Francisco, CA
January 2021 – May 2022
Technical Lead - Twitter Open Source Program Office
The OSPO was an on-off-on-again department which was responsible for managing Twitter's open source ecosystem and it's relationship to the company, facilitate open source initiatives, and maintain membership and relationships with open source organizations and foundations. For many years, this office went unfunded or underfunded before renewed focus saw the office brought back in late 2020.

Led initiative and due diligence on vendors to help with third party vulnerability scanning and remediation, eventually choosing Snyk.
 — Worked with new CISO and the Security org to gather requirements and meet with vendors.
 — Worked with vendors and internal teams to prototype solutions.
 — Worked with Snyk, Security org and internal teams to get alpha integration of Snyk software integrated into the Twitter SDLC and build lifecycle.

Unowned 3rd Party dependency Working Group Lead: helped to come up with the definition and tiers of ownership for 3rd party libraries in the central code monorepo. Worked to catalog and find owners for all unowned JVM 3rd party libraries in the central code monorepo.

Creator of the Open Source Project status model and associated labels.

Led the discussion and work to decide on a standard metadata description for Open Source projects extensible to internal projects to help with the "system comprehension" work to register and catalog internal services.

Proposed, led, and assisted various technology migration efforts across engineering as part of the Twitter Migrations Working Group (MWG).

Wrote the primer on "How to open source code at Twitter" and technical documentation on using GitHub actions and performing open source releases via the OSSRH.

Developed high-performant internal GitHub API HTTP client in Scala using Finagle.

Developed Open Source project cataloging service pulling data from GitHub on Twitter Open Source projects and uploading to a set of BigQuery tables in order to allow Product Managers access for developing insights into Twitter's open source landscape.

Maintained and improved the internal "GitHub Manager" service -- originally an intern project written in Python. Added mTLS support and distributed logging as well as Okta integration for login.

Served as company GitHub administrator, supporting engineers open sourcing new projects and GitHub repository membership maintenance and administration. Answered customer questions and tickets.
Twitter
San Francisco, CA
January 2016 – January 2021
Senior Member, Core Systems Libraries (CSL) Team
The Core Systems Libraries team was responsible for developing, supporting, and maintaining the foundational Twitter-stack libraries for distributed systems. Thousands of internal Twitter microservices and numerous Open Source consumers consumed and extended these libraries.

The Open Source Twitter-stack projects owned by the CSL team include the following:
 — Util: https://github.com/twitter/util
 — Scrooge: https://github.com/twitter/scrooge
 — Finagle: https://github.com/twitter/finagle
 — TwitterServer: https://github.com/twitter/twitter-server
 — Finatra: https://github.com/twitter/finatra
 — Dodo: https://github.com/twitter/dodo

Architect and implementor of internal general Audit Logging system for microservices in support of the Security org for incident response and triage.
 — Led requirements gathering and worked with various infrastructure teams for support of agreed upon implementation.
 — Work done in conjunction with Security org to define use cases and guidelines for teams as part of engineering-wide GDPR (and later, general "Privacy & Data Protection" (PDP)) efforts.
 — Worked directly under the CTO and provided updates to leadership.
 — Performed technology evaluations and due diligence.
 — Architected a distributed audit-trail logging solution for microservices and implemented various library integrations to help teams more easily adopt.
 — Solution helped pave the way for adoption of Splunk as the general distributed logging system of record (moving away from a lagging homegrown solutions).

Lead of several engineering-wide focus initiatives under the #Velocity objective (and later #FrictionlessPlatform) which endeavored to better integrate Platform tooling and components more holistically with better primitives for customers to alleviate the need for developers to be experts across all tools.

Led the (large) undertaking to move the TwitterServer library from util-logging (a JUL wrapper in Scala) to the SLF4J-API (one step in a larger effort to move core libraries away from JUL and to SLF4J-API):
 — An eventual multi-year effort to patch all running systems.
 — Major work as the move shifted from the TwitterServer library giving services a JUL implementation, to requiring users to bring an implementation (with Logback as the recommended implementation).
 — Work made challenging by the lack of holistic ways to validate services in general and little visibility into proper logging configurations more specifically.
 — Downstream frameworks like Finatra (and other internal libraries) needed to be patched in order to support a myriad of legacy cases with the slow eventual unwinding over years [link].
 — Removed problematic configuration and code from team's server configuration files, eventually touching thousands of files and hundreds of services owned by other teams. Worked with teams to explain and verify changes.

Creator and maintainer of internal microservice scaffolding library ("Beaker") for easily creating new Finatra-based microservices and applications.

Creator and maintainer of the Finatra framework & primary documentation author.

Provided Finatra support to both internal and external users.

Creator and maintainer of the Dodo project builder and associated GitHub Action.

Creator and maintainer of several Twitter Util projects:
 — util-slf4j-api
 — util-slf4j-jul-bridge
 — util-validator & primary documentation author
 — util-jackson & primary documentation author
 — util-reflect
 — util-mock

A primary contributor to the Twitter Util library.

A primary contributor to the TwitterServer server framework.

Served as representative to Platform Infastructure senior-IC group.

Helped various framework and library technology migration efforts across engineering.
Twitter
San Francisco, CA
April 2013 – January 2016
Technical Lead Data API Team
Architect and Senior Engineer for Nielsen Twitter TV Rating (NTTR) System ("Project Kingfisher") [8] [9] [10].
 — Led requirements gathering with Nielsen company, SocialGuide [11] -- functioning as PM, and TL through the first 3 phases of the project. The team eventually expanded to 4 full-time engineers, a PM, TPM, and a partner engineer.
 — Project expanded to other partners in different global markets: Japan, Italy, Spain, Great Britain, Australia, and France in addition to Nielsen in the US [12] [13].
 — The design is a self-repairing task system that ingested Tweet IDs about particular TV shows in a market from partners. These came in hourly buckets for reporting which the system would use to then crank over Twitter's engagement data on each Tweet to return anonymized hourly bucketed information on authors and user engagements.
 — The system maintained a "sandbox" set of endpoints which were the first to be rolled with updates such that partners could validate against incoming changes without affecting production workloads.
 — The project included creating one of the first Scala clients for the internal Blobstore (internal AWS S3 equivalent)
 — Also included creating one of the first Scala clients to the internal "NoSQL" K/V store: "Manhattan"

Architect and Senior Engineer for Twitter 2014 Midterm Election framework powering the 2014 Midterm election dashboard: https://blog.twitter.com/en_us/a/2014/introducing-the-twitter-us-2014-election-website.

Maintainer of the primary client event ingestion system ("Rufous") which powered all company metrics and ML models.

Performed due diligence on target companies for acquisition [14].

Created and open-sourced v2 of the Finatra framework.

Summer intern mentor.
Twitter
San Francisco, CA
October 2012 – April 2013
Senior Member, The API Team
Ported many Twitter Ruby-on-Rails application API endpoints to new Scala-based service (while learning Scala).

Helped create a "tap compare" system for validating new Scala-based API endpoints against existing Rails endpoints.

Optimized bare-metal deployments of massive Scala application ("Woodstar") serving migrated Twitter API endpoints

Summer intern mentor.

Active in interviewing and hiring new engineers.
Flite
San Francisco, CA
February 2012 – October 2012
Principal Engineer/Architect
Returned to Flite in a lesser management role after a stint at Heroku with the hope to focus more as an individual contributor.

Served as manager of the company Operations team and performed the role of systems architect, code reviewer, lead engineer, and DevOps engineer. In my spare time, I function as a platform architect, code reviewer, and dev-tool implementer.

Created an internal developer tool (Ruby gem) for automating mundane developer tasks.

Worked on moving the company over from subversion to git and Github for code repository.

Prototyped new metrics workflow architecture using AWS Java SDK to submit jobs to AWS EMR and made use of SQS and SNS to monitor and report on re-tries and failures.

Prototyped a new application deployment system using AWS Simple workflow.

Worked on a new architecture for metrics collection and aggregation using AWS HBase support.

Co-inventor on US Patent No. 20130007108.

Flite was acquired by Snap, Inc. in December 2016.
Heroku
San Francisco, CA
October 2011 – February 2012
Senior Member, Technical Staff
Heroku (pronounced her-OH-koo) is a polyglot cloud application platform for building and deploying web apps.

Worked on platform payment system, migrating applications from Rails 2.x to Rails 3.x. Architected new event-based billing system to integrate with core event processor to allow for better billing precision.

Worked on third-party integration ("add-ons") API to genericize disparate pieces into a coherent system.

Prototyped internal metrics system using Clojure and ClojureScript to funnel data from Splunk forwarders to internal "visibility" systems for analysis of platform metrics.
Widgetbox
San Francisco, CA
May 2007 – July 2011
Director of Engineering
Principle Engineer serving as Director of Engineering.

Helped grow the company from a 9-person team to 60+ employees including setting up new development and QA practices, introducing build, release, and continuous integration systems, and mentoring and leading other developers.

Implemented company pixel-based tracking mechanism metrics collection infrastructure.

Developed Hadoop + Hive framework for MapReduce enormous amount of data collected on ads running in the wild. Expanded real-time metrics collection and reporting infrastructure using Redis via the JRedis library for Java.

Architected and implemented a company self-service recurring billing payment system.

Helped implement Memcached caching layer around DAOs using aspects. Helped architect and implement re-design to the serving platform.

Helped to design and implement scalable feed and content proxies using Memcached and CDN caching. Implemented a feed aggregator and builder using Java, AWS SimpleDB and S3.
Implemented a company URL shortening service in Java using a distributed counter in SimpleDB.

Set up and maintained a continuous integration environment using Hudson and Sonar.
Helped design & implement testable code infrastructure using Spring IoC framework, Hibernate, and TestNG.

Implemented automated regression test framework using Selenium/Webdriver. Prototyped with Selenium IDE, Selenium RC, and Selenium Grid.

Implemented a Maven build process to replace homegrown Ant solution. Set up internal Nexus repository and became de-facto release engineer.

Helped answer and debug customer & end-user support issues. Primary second-level support for self-service billing and payment-related issues.

Served as a member of the company operations team. Provided on-call 24x7 support for application infrastructure and development liaison to the team. Contributed to operations roadmap, priorities, infrastructure, and development.

Company re-branded to Flite in March 2011.
GameSpot
San Francisco, CA
January 2006 – February 2007
Senior Software Engineer, GameSpot (CNET Entertainment, CNET Networks)
Architected and implemented a distributed Java server solution for managing large-size media content downloads from CNET's stack to a windows client service.

Built a component for managing system bandwidth at the point of download based on SNMP monitoring (using SNMP4J).

Prototyped a P2P-based solution for chunking and distributing content across non-fee-based users for exclusive use by fee-based subscribers.

Developed a Java web service in-game score reporting and tournament management tool for integration with GameSpot's tournament management architecture.

Interviewed and hired the client-side development team.

Co-inventor on US Patent No. 20090327079.
Apple Computer, Inc.
Cupertino, CA
February 2005 – November 2005
Senior Programmer/Analyst, IS&T Retail Internet Applications
Led onshore development for point-of-sale client/server solution for Apple Retail stores.

Designed solutions, performed code reviews and managed integration with an offshore component.

Re-designed and re-wrote legacy POS server using an SOA approach in Java.

Added more scalability and redundancy to POS system by adding in-store infrastructure.

Helped troubleshoot in-store issues with retail staff over phone.

Architected and implemented new Java server application and stack behind Apple's EasyPay™ mobile point-of-sale solution -- implemented on a strict and very tight timeline.
— https://appleinsider.com/articles/05/12/30/easypay_a_big_success_at_apple_retail_stores— https://appleinsider.com/articles/09/11/03/exclusive_look_at_apples_new_ipod_touch_based_easypay_checkout

Provided technical direction and code for client-side functionality running on Symbian devices.

Helped develop processes to aid in the software development process including source-code management and build & release processes.

Interviewed and built out onshore team (both full-time and contractor positions).
Vignette, Corp.
San Francisco, CA
September 2002 – November 2004
Senior Software Engineer, Application Builder Team
(via Epicentric, Inc. acquisition)

Architected and wrote company Web Services for Remote Portlets (WSRP) Producer.

Created a generic "web-service" parser. Given a location to a WSDL file (either URL or via browsing UDDI), the code could read all operations and expose them as remote procedure calls consumable by the rest of the server framework. This allowed for great extensibility inside of the company's Application Builder product.

Developed a Java web-services toolkit to aid in integrating various company products. The toolkit provided a flexible way to expose each product's API as a web service wrapped in WS-Security.

Served as representative and voting member on the WSRP TC.

Functioned as an editor and contributor to the WSRP TC Frequently Asked Questions (FAQ) document for version 1.0 of the protocol.
Epicentric, Inc.
San Francisco, CA
December 2000 – September 2002
Senior Software Engineer, Module Team
Designed and implemented custom Java object-oriented web modules to run within the company's portal framework.

Designed and created portlet applications to integrate with the company's proprietary content management system as well as with Outlook Email & Outlook Tasks.

Implemented a single-sign-on (SSO) solution into the server application which allowed for pluggable SSO authorities.

The company was acquired by Vignette, Corp. in October 2002.
Context Integration
South San Francisco, CA
August 1999 – December 2000
Consultant, E-Commerce and Web Solutions Group
With one other engineer, wrote a Java administrator interface for an intranet community framework. The tool was integrated with third-party tools such as polls, chats, and discussion boards.

Developed with a team of 5 engineers an internet training portal using BroadVision for a computer-based training company.

Integrated Documentum's document management system with a custom Java-based knowledge management system running on BEA's WebLogic application server for a large venture capital firm.

Led quality assurance team in building & testing applications for an internet-based transportation company. Responsibilities included defect tracking, Use-Case management, test planning, and client management.

Implemented functional and load tests using Rational Performance Studio software for numerous projects as part of the Testing team.

Context was sold to eFORCE in 2002.

Context in the news:
— https://www.cnet.com/tech/tech-industry/new-crop-of-services-firms-vies-for-the-spotlight/
— https://www.fastcompany.com/37955/ideascom
— https://money.cnn.com/magazines/fortune/fortune_archive/2000/03/20/276369/index.htm
— https://www.crn.com/news/channel-programs/18821685/eforce-completes-acquisition-of-context-integration.htm
Rice University Space Physics & Astronomy Department
Houston, TX
July 1997 – May 1999
Research Assistant
Completed undergraduate senior thesis work on analyzing the unexplained broadening of spectral lines from the Orion Nebula using WFPC2 data obtained from the Hubble space telescope and ground-based data from the W. M. Keck Observatory in Maunakea, Hawai'i.

Served as an assistant researcher for two professors of Astronomy. Tasks included extensive work in spectral line analysis, waves and optics, spectrometry, spectroscopy, and statistical thermodynamics. Used data reduction techniques to quantify previous research results and verify theoretical models with observed data. Work included heavy usage of Unix machines and Unix shells. Performed data reduction and analysis on multiple papers published by the professors.

Credited in Hubble Space Telescope Faint Object Spectrograph Optical and Ultraviolet Spectroscopy of the Bow Shock HH 47A by Hartigan, et al.

Performed basic UNIX administration of the department's UNIX network.

Patents

 Certificates

Volunteer

Ultimate Impact
San Francisco Bay Area
December 2016 – December 2022
President of the Board of Directors
Ultimate Impact is a nonprofit that offers at-risk youth a fun and active framework for social, emotional, and physical development by providing a positive emotional outlet, adult role models, and a supportive team community through ultimate Frisbee. Due to the Spirit of the Game and with a focus on sportsmanship and camaraderie, ultimate has the ability to create a strong community for players across a spectrum of geographies and backgrounds. Since ultimate is self-officiating, players learn to take responsibility for their own behavior and are empowered to use their own judgment and ethics to govern the game play.

Ultimate Impact provides a safe, positive, and inclusive environment for girls and boys. Given the strengths of the sport and its emphasis on fair play and self-regulation in particular, Ultimate Impact strengthens the physical, social, and emotional development of youth (ages 6-18) from underrepresented communities.

Served as president of the board directors for the organization, helping it grow from 3 board members and 1 full-time employee to 7 board members, 5 full-time staff, 12 part-time staff, and many amazing volunteers.
Code2040
San Francisco, CA
June 2018 – September 2018
Mentor
Served as a Fellows Mentor
Tenderloin Technology Lab
San Francisco, CA
December 2012 – October 2016
Personal Tutor
Helped adults answer a range of computer-related questions from creating resumes, filling out job or housing applications, setting up social-media accounts, and scanning documents.
Code2040
San Francisco, CA
June 2016 – August 2016
Mentor
Served as a Fellows Mentor

Projects

  • Finatra: Fast, testable, Scala HTTP services built on Twitter-Server and Finagle.
  • Dodo: The Twitter OSS Project Builder.
  • Dodo-Build: A Github Action for running Dodo: The Twitter OSS Project Builder.
  • Twitter Util: Wonderful reusable code from Twitter.
  • TwitterServer: Twitter-Server defines a template from which services at Twitter are built.
  • Scrooge: A Thrift parser/generator.
  • Finagle: A fault tolerant, protocol-agnostic RPC system.
  • clj-ua: A user-agent parser in clojure.

Contact

San Francisco, CA US
LinkedIn
GitHub

Education

Skills

Distributed Systems +
avatar

Christopher Coco
Principal Software Engineer

About

I like to build scalable things.

And drink coffee.

I am a Principal Software Engineer with many years of experience specializing in Distributed Systems, Platform Infrastructure, API Frameworks & Design, and Open Source Software located in San Francisco, CA. I pride myself on mentorship and enjoy the feeling of accomplishment from helping others realize they belong.

Work Experience

Verrus
San Francisco Bay Area, CA
November 2023 - Present
Principal Engineer, Software Infrastructure Lead
Leading infrastructure development at Verrus.
Personal goal pursuit
San Francisco Bay Area, CA
November 2022 - November 2023
Career Break
I am currently focused on being a stay-at-home Dad to my young children.
Twitter
San Francisco, CA
October 2012 – November 2022
Sr. Staff Software Engineer
Software engineer working at a Principal level across the company, primarily in the Platform (infrastructure) organization. Throughout my time at Twitter and in my various roles, I have actively focused on making a positive impact, including:

@Blackbirds Employee Resource Group Lead [2015-2016].

Volunteer and volunteer coordinator - Tenderloin Technology Lab at St. Anthony's [2012 - 2016].

Twitter Engineering Mentor Program, New Hire & Intern mentor.

Twitter Open Source Shepherd and Technical Design Shepherd for many infrastructure and product projects.

Founding member of Engineering Interview Process standardization ("Luna" Process) and founding interview shepherd (+1 reviewer model). Luna Process course instructor for new hires.

Multiple-time attendee to conferences for recruiting and candidate interviewing on behalf of multiple teams (Tapia, NSBE, Grace Hopper) [1] [2] [3] [4] [5] [6] [7].

Twitter Earlybird Camp interviewer, mentor & judge, Twitter #FirstFlight interviewer, panelist & Twitter Academy cultural mentor.

Introduction to Finatra course instructor.

Open source at Twitter course material reviewer and instructor.

Mentor for multiple University of San Francisco Computer Science Capstone Projects [2018]

Member of the Twitter Technical Architecture Group (TAG).

Co-chair, member, and multiple working group leader of the Platform Infrastructure senior IC Group (Platforum).

Member of the Twitter Engineering Migrations Working Group (MWG); helped plan, execute, and track technology migrations across engineering.

Constant cross-team work to improve Developer Experience and increase developer productivity.

A recognized leader in the area of JVM logging technologies.

Led various company GDPR initiatives.

Supported thousands of internal and external customers of the Finatra framework; frequent contributor to other teams' projects, and a champion of testing and writing tests.
Twitter
San Francisco, CA
May 2022 – November 2022
Technical Lead - Compute Integrations Team
The Compute organization provided a scalable, efficient, and cost-effective computing platform for all of Twitter. The Compute Integrations Team was responsible for integrating Kubernetes with various Twitter-specific technologies like Service Discovery, application configuration federation, application observability, and chargeback. The team was also fully responsible for the Compute-org-managed Kubernetes clusters in GCP.

Work to optimize service discovery in Kubernetes clusters by moving the service discovery infrastructure in Kubernetes to be regional (in this case per data center) rather than per cluster.

Work to design an automated way of on-premise Kubernetes cluster discovery and registration for better integration into existing Twitter infrastructure and more visibility and introspection into the running clusters.

High-priority work to secure the global package store infrastructure ("Packer"):
 — Java-based Finatra service with a python client. The client is distributed on developer laptops, via the package store for other infrastructure components, e.g. CI/CD components for package retrieval, and via a Linux RPM for data center host management infrastructure services.
 — Work involved updating the server to support both internal mutual-TLS (mTLS) and TLS (in addition to Kerberos) and updating the Python client to ensure it negotiated connections from the various locations of deployment correctly (either mTLS where a client certificate could be presented or via TLS where Kerberos was also in use).
 — A massive undertaking to update all instances of the distributed Python client which involved multiple Puppet runs to release new versions to the data center machines (with minimal documentation and a dwindling number of experts around to ensure that catastrophe was avoided).
Twitter
San Francisco, CA
January 2021 – May 2022
Technical Lead - Twitter Open Source Program Office
The OSPO was an on-off-on-again department which was responsible for managing Twitter's open source ecosystem and it's relationship to the company, facilitate open source initiatives, and maintain membership and relationships with open source organizations and foundations. For many years, this office went unfunded or underfunded before renewed focus saw the office brought back in late 2020.

Led initiative and due diligence on vendors to help with third party vulnerability scanning and remediation, eventually choosing Snyk.
 — Worked with new CISO and the Security org to gather requirements and meet with vendors.
 — Worked with vendors and internal teams to prototype solutions.
 — Worked with Snyk, Security org and internal teams to get alpha integration of Snyk software integrated into the Twitter SDLC and build lifecycle.

Unowned 3rd Party dependency Working Group Lead: helped to come up with the definition and tiers of ownership for 3rd party libraries in the central code monorepo. Worked to catalog and find owners for all unowned JVM 3rd party libraries in the central code monorepo.

Creator of the Open Source Project status model and associated labels.

Led the discussion and work to decide on a standard metadata description for Open Source projects extensible to internal projects to help with the "system comprehension" work to register and catalog internal services.

Proposed, led, and assisted various technology migration efforts across engineering as part of the Twitter Migrations Working Group (MWG).

Wrote the primer on "How to open source code at Twitter" and technical documentation on using GitHub actions and performing open source releases via the OSSRH.

Developed high-performant internal GitHub API HTTP client in Scala using Finagle.

Developed Open Source project cataloging service pulling data from GitHub on Twitter Open Source projects and uploading to a set of BigQuery tables in order to allow Product Managers access for developing insights into Twitter's open source landscape.

Maintained and improved the internal "GitHub Manager" service -- originally an intern project written in Python. Added mTLS support and distributed logging as well as Okta integration for login.

Served as company GitHub administrator, supporting engineers open sourcing new projects and GitHub repository membership maintenance and administration. Answered customer questions and tickets.
Twitter
San Francisco, CA
January 2016 – January 2021
Senior Member, Core Systems Libraries (CSL) Team
The Core Systems Libraries team was responsible for developing, supporting, and maintaining the foundational Twitter-stack libraries for distributed systems. Thousands of internal Twitter microservices and numerous Open Source consumers consumed and extended these libraries.

The Open Source Twitter-stack projects owned by the CSL team include the following:
 — Util: https://github.com/twitter/util
 — Scrooge: https://github.com/twitter/scrooge
 — Finagle: https://github.com/twitter/finagle
 — TwitterServer: https://github.com/twitter/twitter-server
 — Finatra: https://github.com/twitter/finatra
 — Dodo: https://github.com/twitter/dodo

Architect and implementor of internal general Audit Logging system for microservices in support of the Security org for incident response and triage.
 — Led requirements gathering and worked with various infrastructure teams for support of agreed upon implementation.
 — Work done in conjunction with Security org to define use cases and guidelines for teams as part of engineering-wide GDPR (and later, general "Privacy & Data Protection" (PDP)) efforts.
 — Worked directly under the CTO and provided updates to leadership.
 — Performed technology evaluations and due diligence.
 — Architected a distributed audit-trail logging solution for microservices and implemented various library integrations to help teams more easily adopt.
 — Solution helped pave the way for adoption of Splunk as the general distributed logging system of record (moving away from a lagging homegrown solutions).

Lead of several engineering-wide focus initiatives under the #Velocity objective (and later #FrictionlessPlatform) which endeavored to better integrate Platform tooling and components more holistically with better primitives for customers to alleviate the need for developers to be experts across all tools.

Led the (large) undertaking to move the TwitterServer library from util-logging (a JUL wrapper in Scala) to the SLF4J-API (one step in a larger effort to move core libraries away from JUL and to SLF4J-API):
 — An eventual multi-year effort to patch all running systems.
 — Major work as the move shifted from the TwitterServer library giving services a JUL implementation, to requiring users to bring an implementation (with Logback as the recommended implementation).
 — Work made challenging by the lack of holistic ways to validate services in general and little visibility into proper logging configurations more specifically.
 — Downstream frameworks like Finatra (and other internal libraries) needed to be patched in order to support a myriad of legacy cases with the slow eventual unwinding over years [link].
 — Removed problematic configuration and code from team's server configuration files, eventually touching thousands of files and hundreds of services owned by other teams. Worked with teams to explain and verify changes.

Creator and maintainer of internal microservice scaffolding library ("Beaker") for easily creating new Finatra-based microservices and applications.

Creator and maintainer of the Finatra framework & primary documentation author.

Provided Finatra support to both internal and external users.

Creator and maintainer of the Dodo project builder and associated GitHub Action.

Creator and maintainer of several Twitter Util projects:
 — util-slf4j-api
 — util-slf4j-jul-bridge
 — util-validator & primary documentation author
 — util-jackson & primary documentation author
 — util-reflect
 — util-mock

A primary contributor to the Twitter Util library.

A primary contributor to the TwitterServer server framework.

Served as representative to Platform Infastructure senior-IC group.

Helped various framework and library technology migration efforts across engineering.
Twitter
San Francisco, CA
April 2013 – January 2016
Technical Lead Data API Team
Architect and Senior Engineer for Nielsen Twitter TV Rating (NTTR) System ("Project Kingfisher") [8] [9] [10].
 — Led requirements gathering with Nielsen company, SocialGuide [11] -- functioning as PM, and TL through the first 3 phases of the project. The team eventually expanded to 4 full-time engineers, a PM, TPM, and a partner engineer.
 — Project expanded to other partners in different global markets: Japan, Italy, Spain, Great Britain, Australia, and France in addition to Nielsen in the US [12] [13].
 — The design is a self-repairing task system that ingested Tweet IDs about particular TV shows in a market from partners. These came in hourly buckets for reporting which the system would use to then crank over Twitter's engagement data on each Tweet to return anonymized hourly bucketed information on authors and user engagements.
 — The system maintained a "sandbox" set of endpoints which were the first to be rolled with updates such that partners could validate against incoming changes without affecting production workloads.
 — The project included creating one of the first Scala clients for the internal Blobstore (internal AWS S3 equivalent)
 — Also included creating one of the first Scala clients to the internal "NoSQL" K/V store: "Manhattan"

Architect and Senior Engineer for Twitter 2014 Midterm Election framework powering the 2014 Midterm election dashboard: https://blog.twitter.com/en_us/a/2014/introducing-the-twitter-us-2014-election-website.

Maintainer of the primary client event ingestion system ("Rufous") which powered all company metrics and ML models.

Performed due diligence on target companies for acquisition [14].

Created and open-sourced v2 of the Finatra framework.

Summer intern mentor.
Twitter
San Francisco, CA
October 2012 – April 2013
Senior Member, The API Team
Ported many Twitter Ruby-on-Rails application API endpoints to new Scala-based service (while learning Scala).

Helped create a "tap compare" system for validating new Scala-based API endpoints against existing Rails endpoints.

Optimized bare-metal deployments of massive Scala application ("Woodstar") serving migrated Twitter API endpoints

Summer intern mentor.

Active in interviewing and hiring new engineers.
Flite
San Francisco, CA
February 2012 – October 2012
Principal Engineer/Architect
Returned to Flite in a lesser management role after a stint at Heroku with the hope to focus more as an individual contributor.

Served as manager of the company Operations team and performed the role of systems architect, code reviewer, lead engineer, and DevOps engineer. In my spare time, I function as a platform architect, code reviewer, and dev-tool implementer.

Created an internal developer tool (Ruby gem) for automating mundane developer tasks.

Worked on moving the company over from subversion to git and Github for code repository.

Prototyped new metrics workflow architecture using AWS Java SDK to submit jobs to AWS EMR and made use of SQS and SNS to monitor and report on re-tries and failures.

Prototyped a new application deployment system using AWS Simple workflow.

Worked on a new architecture for metrics collection and aggregation using AWS HBase support.

Co-inventor on US Patent No. 20130007108.

Flite was acquired by Snap, Inc. in December 2016.
Heroku
San Francisco, CA
October 2011 – February 2012
Senior Member, Technical Staff
Heroku (pronounced her-OH-koo) is a polyglot cloud application platform for building and deploying web apps.

Worked on platform payment system, migrating applications from Rails 2.x to Rails 3.x. Architected new event-based billing system to integrate with core event processor to allow for better billing precision.

Worked on third-party integration ("add-ons") API to genericize disparate pieces into a coherent system.

Prototyped internal metrics system using Clojure and ClojureScript to funnel data from Splunk forwarders to internal "visibility" systems for analysis of platform metrics.
Widgetbox
San Francisco, CA
May 2007 – July 2011
Director of Engineering
Principle Engineer serving as Director of Engineering.

Helped grow the company from a 9-person team to 60+ employees including setting up new development and QA practices, introducing build, release, and continuous integration systems, and mentoring and leading other developers.

Implemented company pixel-based tracking mechanism metrics collection infrastructure.

Developed Hadoop + Hive framework for MapReduce enormous amount of data collected on ads running in the wild. Expanded real-time metrics collection and reporting infrastructure using Redis via the JRedis library for Java.

Architected and implemented a company self-service recurring billing payment system.

Helped implement Memcached caching layer around DAOs using aspects. Helped architect and implement re-design to the serving platform.

Helped to design and implement scalable feed and content proxies using Memcached and CDN caching. Implemented a feed aggregator and builder using Java, AWS SimpleDB and S3.
Implemented a company URL shortening service in Java using a distributed counter in SimpleDB.

Set up and maintained a continuous integration environment using Hudson and Sonar.
Helped design & implement testable code infrastructure using Spring IoC framework, Hibernate, and TestNG.

Implemented automated regression test framework using Selenium/Webdriver. Prototyped with Selenium IDE, Selenium RC, and Selenium Grid.

Implemented a Maven build process to replace homegrown Ant solution. Set up internal Nexus repository and became de-facto release engineer.

Helped answer and debug customer & end-user support issues. Primary second-level support for self-service billing and payment-related issues.

Served as a member of the company operations team. Provided on-call 24x7 support for application infrastructure and development liaison to the team. Contributed to operations roadmap, priorities, infrastructure, and development.

Company re-branded to Flite in March 2011.
GameSpot
San Francisco, CA
January 2006 – February 2007
Senior Software Engineer, GameSpot (CNET Entertainment, CNET Networks)
Architected and implemented a distributed Java server solution for managing large-size media content downloads from CNET's stack to a windows client service.

Built a component for managing system bandwidth at the point of download based on SNMP monitoring (using SNMP4J).

Prototyped a P2P-based solution for chunking and distributing content across non-fee-based users for exclusive use by fee-based subscribers.

Developed a Java web service in-game score reporting and tournament management tool for integration with GameSpot's tournament management architecture.

Interviewed and hired the client-side development team.

Co-inventor on US Patent No. 20090327079.
Apple Computer, Inc.
Cupertino, CA
February 2005 – November 2005
Senior Programmer/Analyst, IS&T Retail Internet Applications
Led onshore development for point-of-sale client/server solution for Apple Retail stores.

Designed solutions, performed code reviews and managed integration with an offshore component.

Re-designed and re-wrote legacy POS server using an SOA approach in Java.

Added more scalability and redundancy to POS system by adding in-store infrastructure.

Helped troubleshoot in-store issues with retail staff over phone.

Architected and implemented new Java server application and stack behind Apple's EasyPay™ mobile point-of-sale solution -- implemented on a strict and very tight timeline.
— https://appleinsider.com/articles/05/12/30/easypay_a_big_success_at_apple_retail_stores— https://appleinsider.com/articles/09/11/03/exclusive_look_at_apples_new_ipod_touch_based_easypay_checkout

Provided technical direction and code for client-side functionality running on Symbian devices.

Helped develop processes to aid in the software development process including source-code management and build & release processes.

Interviewed and built out onshore team (both full-time and contractor positions).
Vignette, Corp.
San Francisco, CA
September 2002 – November 2004
Senior Software Engineer, Application Builder Team
(via Epicentric, Inc. acquisition)

Architected and wrote company Web Services for Remote Portlets (WSRP) Producer.

Created a generic "web-service" parser. Given a location to a WSDL file (either URL or via browsing UDDI), the code could read all operations and expose them as remote procedure calls consumable by the rest of the server framework. This allowed for great extensibility inside of the company's Application Builder product.

Developed a Java web-services toolkit to aid in integrating various company products. The toolkit provided a flexible way to expose each product's API as a web service wrapped in WS-Security.

Served as representative and voting member on the WSRP TC.

Functioned as an editor and contributor to the WSRP TC Frequently Asked Questions (FAQ) document for version 1.0 of the protocol.
Epicentric, Inc.
San Francisco, CA
December 2000 – September 2002
Senior Software Engineer, Module Team
Designed and implemented custom Java object-oriented web modules to run within the company's portal framework.

Designed and created portlet applications to integrate with the company's proprietary content management system as well as with Outlook Email & Outlook Tasks.

Implemented a single-sign-on (SSO) solution into the server application which allowed for pluggable SSO authorities.

The company was acquired by Vignette, Corp. in October 2002.
Context Integration
South San Francisco, CA
August 1999 – December 2000
Consultant, E-Commerce and Web Solutions Group
With one other engineer, wrote a Java administrator interface for an intranet community framework. The tool was integrated with third-party tools such as polls, chats, and discussion boards.

Developed with a team of 5 engineers an internet training portal using BroadVision for a computer-based training company.

Integrated Documentum's document management system with a custom Java-based knowledge management system running on BEA's WebLogic application server for a large venture capital firm.

Led quality assurance team in building & testing applications for an internet-based transportation company. Responsibilities included defect tracking, Use-Case management, test planning, and client management.

Implemented functional and load tests using Rational Performance Studio software for numerous projects as part of the Testing team.

Context was sold to eFORCE in 2002.

Context in the news:
— https://www.cnet.com/tech/tech-industry/new-crop-of-services-firms-vies-for-the-spotlight/
— https://www.fastcompany.com/37955/ideascom
— https://money.cnn.com/magazines/fortune/fortune_archive/2000/03/20/276369/index.htm
— https://www.crn.com/news/channel-programs/18821685/eforce-completes-acquisition-of-context-integration.htm
Rice University Space Physics & Astronomy Department
Houston, TX
July 1997 – May 1999
Research Assistant
Completed undergraduate senior thesis work on analyzing the unexplained broadening of spectral lines from the Orion Nebula using WFPC2 data obtained from the Hubble space telescope and ground-based data from the W. M. Keck Observatory in Maunakea, Hawai'i.

Served as an assistant researcher for two professors of Astronomy. Tasks included extensive work in spectral line analysis, waves and optics, spectrometry, spectroscopy, and statistical thermodynamics. Used data reduction techniques to quantify previous research results and verify theoretical models with observed data. Work included heavy usage of Unix machines and Unix shells. Performed data reduction and analysis on multiple papers published by the professors.

Credited in Hubble Space Telescope Faint Object Spectrograph Optical and Ultraviolet Spectroscopy of the Bow Shock HH 47A by Hartigan, et al.

Performed basic UNIX administration of the department's UNIX network.

Volunteer

Ultimate Impact
San Francisco Bay Area
December 2016 – December 2022
President of the Board of Directors
Ultimate Impact is a nonprofit that offers at-risk youth a fun and active framework for social, emotional, and physical development by providing a positive emotional outlet, adult role models, and a supportive team community through ultimate Frisbee. Due to the Spirit of the Game and with a focus on sportsmanship and camaraderie, ultimate has the ability to create a strong community for players across a spectrum of geographies and backgrounds. Since ultimate is self-officiating, players learn to take responsibility for their own behavior and are empowered to use their own judgment and ethics to govern the game play.

Ultimate Impact provides a safe, positive, and inclusive environment for girls and boys. Given the strengths of the sport and its emphasis on fair play and self-regulation in particular, Ultimate Impact strengthens the physical, social, and emotional development of youth (ages 6-18) from underrepresented communities.

Served as president of the board directors for the organization, helping it grow from 3 board members and 1 full-time employee to 7 board members, 5 full-time staff, 12 part-time staff, and many amazing volunteers.
Code2040
San Francisco, CA
June 2018 – September 2018
Mentor
Served as a Fellows Mentor
Tenderloin Technology Lab
San Francisco, CA
December 2012 – October 2016
Personal Tutor
Helped adults answer a range of computer-related questions from creating resumes, filling out job or housing applications, setting up social-media accounts, and scanning documents.
Code2040
San Francisco, CA
June 2016 – August 2016
Mentor
Served as a Fellows Mentor

GitHub Projects

  • Codemetagenerator: Interactive generator to create a CodeMeta SoftwareSourceCode description written in Go..
  • ångstrom.io: A Kotlin application framework and utilities.
  • Finatra: Fast, testable, Scala HTTP services built on Twitter-Server and Finagle.
  • Dodo: The Twitter OSS Project Builder.
  • Dodo-Build: A Github Action for running Dodo: The Twitter OSS Project Builder.
  • Twitter Util: Wonderful reusable code from Twitter.
  • TwitterServer: Twitter-Server defines a template from which services at Twitter are built.
  • Scrooge: A Thrift parser/generator.
  • Finagle: A fault tolerant, protocol-agnostic RPC system.
  • clj-ua: A user-agent parser in clojure.

Patents

 Certifications

Education

Skills

Distributed Systems Senior
Scheduling Scalability Client / Server