Data engineering
Data engineering involves ensuring the correct systems are available to enable the collection, analysis and extrapolation of data.
Níveis
- 1. Noção
You can:
- explain why you need engineering support to design and provide products for the organisation
- explain why you need to cleanse and prepare data for use in data science products
- explain different architectures, including cloud and on-premise, and data manipulation and transformation tools
- 2. Aplicação
You can:
- identify the appropriate engineering support to design and provide products for the organisation
- recognise the processes and tools for cleansing and preparing data, and put reusable processes and checks in place
- use different architectures, including cloud and on-premise
- use data manipulation and transformation tools
- 3. Domínio
You can:
- work with data engineers and data scientists to design and provide products for the organisation
- 4. Especialista
You can:
- help to identify the data engineering requirements for any data science product, while working with data engineers and data scientists to design and deliver those products into the organisation effectively
- understand the need to cleanse and prepare data before including it in data science products and can put reusable processes and checks in place
- understand a broad range of architectures, including cloud and on-premise, and data manipulation and transformation tools deployed within the organisation, and can use these tools appropriately and help others use them
Contains public sector information from the UK Government Digital and Data Profession Capability Framework (https://understand-digital-data-roles-skills.service.gov.uk/), licensed under the Open Government Licence v3.0. © Crown copyright.
Competências do ESCO mais próximas
Contains ESCO v1.2.1 data (https://esco.ec.europa.eu/). © European Union. Reuse authorised under Commission Decision 2011/833/EU.
Níveis de função que exigem esta competência
| Nível da função | Função | Faixa | Nível esperado |
|---|---|---|---|
| Cientista de dados trainee | Cientista de dados | 4 | Noção |
| Cientista de dados associado | Cientista de dados | 5 | Aplicação |
| Cientista de dados | Cientista de dados | 6 | Domínio |
| Cientista de dados principal | Cientista de dados | 7 | Especialista |
| Cientista de dados líder | Cientista de dados | 8a | Especialista |
| Chefia de ciência de dados | Cientista de dados | 8b | Domínio |