The 2021 My LA2050 Grants Challenge is here! We're giving away $1 million to make LA the best place to live, learn, play, create, and connect.

Learn more

California College Guidance Initiative

Data Engineer, Data Infrastructure and Analytics

Employment type
3 months ago
Remote within California

The California College Guidance Initiative is looking for a data engineering expert to join the Data Infrastructure and Analytics Team. As part of the Data Infrastructure and Analytic Team, you will be a key strategic leader in the expansion, refinement, and continued development of CCGI’s infrastructure utilizing Amazon Web Services (AWS), as well as continuing to build out our data analytics and engineering tools. This role will be instrumental in helping us scale our work statewide and open the door for expanded use of California's official college and career planning platform for K-12th grade students, parents, and educators,

The ideal candidate for this team has extensive experience building out complex data architectures, including the testing, maintenance, and refinement of all data pipelines. They also have experience successfully scaling up an organization’s data intake to terabytes and petabytes of data, as well as optimizing data delivery and automating manual processes. This person is comfortable working with structured and unstructured data and can troubleshoot data loading and processing tools via SQL, Python, shell scripting, AWS, etc., and take on a leadership role in special projects when needed.
Additionally, this person had extensive experience developing robust data documentation and data governance protocols.

There are no direct supervisory responsibilities for this position, but you must be able to proactively and successfully partner and collaborate with other subject matter experts on a project management basis. Lastly, you must be comfortable leading and project managing work with many unknowns and ambiguous solutions, as well as carry a deep knowledge and/or curiosity about the needs and behaviors of students, educators, and parents, and a passion for educational equity. 

What Will You Be Doing?

  • Manage, refine, and enhance AWS cloud services infrastructure which include the following: EC2, VPC, RDS, CloudWatch, CloudFormation, CloudTrail, Transfer for sFTP, S3, Lambda, Secrets Manager, and Route 53.
  • Lead ETL/ELT processes which include the development, refinement, and implementation of data loading and processing tools, including Snowflake, Airflow, Python, SQL, and shell scripts.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, designing infrastructure for greater scalability and automation.
  • Maintain and update documentation of data architecture from both the macro view (i.e. architectural diagrams) and the micro view (i.e. script level tasks in Airflow).
  • Lead meetings, research processes, collect data, analyze information and collaborate with the key stakeholders of your projects.
  • Develop and maintain expert knowledge of
  • Continuously improve data pipelines and architecture by staying updated on industry trends and best practices.


What Technical Skills Do You Need? 

  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Advanced proficiency with big data tools: AWS, Snowflake, Hadoop, Spark, Kafka, etc.
  • Advanced proficiency with ETL tools like Matillion, Talend, etc.
  • Advanced proficiency with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Advanced proficiency building and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Advanced proficiency with scripting languages like Python, R, etc.
  • Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases.
  • AWS Certification as a Solutions Architect - Professional
  • A successful history of manipulating, processing and extracting value from large structured and unstructured datasets.


What Intangibles Do You Need? 

  • Strong decision-making skills and collaborative spirit with the ability to take abstract brainstorming and generate concrete proposals for action.
  • Advance projects without detailed supervision, balancing multiple responsibilities, and providing colleagues with actionable proposals for advancing collective efforts.
  • Thrive in a fast-paced environment with changing priorities and deadlines.
  • Juggle multiple projects of various scopes with ease and grace. 
  • Meticulous attention to detail. 
  • Excellent verbal communication skills; ability to communicate with various levels of professionals.
  • Strong organizational, project, and time management skills.


More About the Data Infrastructure and Analytics Team
The team oversees all of CCGI’s internal cloud-based data analytics and engineering infrastructure and technical strategy. This includes data analytics, data warehousing, and data engineering projects, ensuring alignment with the organization's mission and goals.

This is a new role for the team. We are keen for you to bring your experience where you can thrive in an environment that allows for knowledge sharing and creates opportunities for you to take initiative to learn even more. This role reports to the Director of Data Infrastructure and Analytics. 

More About CCGI
The California College Guidance Initiative (CCGI) works to ensure that all 6th-12th grade students in California have access to a systematic baseline of guidance and support as they plan, prepare, and pay for postsecondary education and training. This baseline is provided by CCGI partners with K-12 school districts to support students, counselors, and parents with the systematic use of, including transcript-informed tools. also houses, audits, and transmits student data to help ensure more accurate and efficient decisions regarding admissions, financial aid, and course placement.

CCGI is a positive, diverse, and supportive culture. At our core, we prioritize the needs of students above all else. 

Everyone at CCGI works remotely. We are all located in various parts of California. We rarely meet in person. Instead, we make use of tools, such as ZOOM, Slack, and Salesforce, to communicate and document our work.

CCGI is housed at the Foundation for California Community Colleges but is an autonomous initiative with its own mission, goals, and leadership team. 


Working Conditions, Travel, and Physical Requirements: 
This is a full-time position, 40 hours per week, with additional hours as needed to address the needs of the organization. Employees are required to have the ability to work remotely successfully and at a computer workstation for periods up to 4 hours at a time and for up to 8 hours per day for up to five consecutive days. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions/physical requirements of the job. Additional requirements are following: 

  • Ability to speak on the telephone for a total of up to 3 hours per day. 
  • Ability to sit for up to 3 hours without breaks at meetings; Ability to walk and stand for up to 4 hours without breaks at program site visits and meetings.
  • Ability to perform repetitive movements, such as typing, filing, and the use of commonly used office machines and supplies.
  • Ability to operate personal vehicle for Foundation business and possess current valid California driver’s license and insurance.
  • Ability to lift and move a minimum of 20 pounds.
  • Well-lighted, heated, and air-conditioned indoor office setting with adequate ventilation. 
  • Pending removal of COVID restrictions, overnight travel (up to 5%) by land and air.
  • This is a remote position that requires a quiet home office space.


Equal Employment Opportunity:
The Foundation for California Community Colleges is committed to providing an environment of mutual respect where equal employment opportunities (EEO) are available to all employees and applicants without regard to race, color, ancestry, national origin, genetic characteristics, sex, gender identity, gender expression, sexual orientation, marital/parental status, political affiliation, religion, age, disability, pregnancy, childbirth, breastfeeding or veteran status. In addition to federal law requirements, The Foundation for California Community Colleges complies with applicable state and local laws governing non-discrimination in employment.

As the official nonprofit auxiliary to the Chancellor's Office, we aim to ensure our team reflects the diversity of the California Community Colleges and the 2.1 million students, campuses, and communities it serves. Individuals are hired for their deep understanding of each population’s unique needs and will join a collaborative environment where each team member plays an important role in helping Californians across all communities improve their social and economic mobility and build a better future for themselves and their families.

To apply

For immediate consideration, please submit a letter of interest and resume saved as Microsoft Word (.doc/.docx) or Adobe Acrobat PDF (.pdf) documents to [email protected] Please include in the subject line: “Data Engineer, California College Guidance Initiative.” The application process will be open until the position is filled.