Expert Data Scientist LLMs - Madrid, España - bbva

Descripción

Area: DATA

Deadline for applying: 6/11/2024

Company: 001

What are we looking for?

STEM talent in the BBVA group: What we offer you?

• You will be part of a team of more than Technology and Data experts, in 25 countries, whose aim is to take the bank further thanks to technology.
• You will participate in one of the close to 1,800 cutting-edge technology projects that we implement annually with a positive impact on 85 million people.
• You will work with a wide range of technologies, from the most experienced to the most disruptive: 46 different programming languages, 201 development platforms, etc.
• You will collaborate with our main tech partners - Microsoft, Google, AWS, Salesforce, IBM, RedHat, Telefonica, Cisco, Genesys, etc.
• You will carry out innovative projects in areas such as Development, Architecture, Security, Infrastructure and Data. .
• You will learn by working in your project, you will work with referents and you will have access to the entire BBVA training offer and to the Ninja project, a gamified training platform with a community of more than 11,000 participants with more than 2,000 talks, 1,300 workshops and 48 hackathons held.

Training

• Bachelor's or Master's degree in Computer Science, Statistics, Mathematics, or a related field.

Specific Knowledge

• Experience in the life cycle of ML models, including research, selection, adaptation, testing, training and monitoring / retraining.
• Advanced technical knowledge of LLMs.
• Discriminative / generative models, fine-tuning / prompt engineering, model optimisation, embedding elicitation and comparison, fine parameterisation, LangChain, etc.).
• Life cycle of LLM-type models.
• Knowledge and ability to define the metrics that would apply to each type and case.
• Data lifecycle management, including identification, prior exploration (EDA), transformation and adaptation to the model/problem, definition of training datasets, validation, testing, dataset tracing, etc.
• Knowledge of the risks inherent in NLP models, especially in their generative component (hallucination of facts, omissions, inherent biases, unpredictability, etc.).
• Experience in ML projects on cloud environments, preferably AWS.
• (Desirable): Experience in other cloud environments: Azure, Google Cloud Platform / Vertex AI.
• (Desirable): Experience in other on-premise environments (Datio / Datio Evo).

Soft skills

• Team spirit: Teamwork, sharing ideas, giving and receiving feedback, empathy, etc.
• Dissemination: Ability to communicate and explain technical matters to a general audience.
• Adaptability: Ability to adapt to changing, demanding and uncertain technical environments.

Overview

We're a group of people with a passion for cutting edge technology, mutual learning and innovative problem solving. We strive to bring the opportunities that Artificial Intelligence offers to the financial industry.

At AI Factory, we are excited to welcome a Data Scientist to our team, dedicated to harnessing the power of LLMs in the financial industry. In this role, you will be at the forefront of managing and executing significant analytical projects within the DATA area. Your responsibilities will include coordinating with team members, aligning with our strategic objectives, and solving complex problems by working closely with cross-functional teams. You will play a key role in identifying business opportunities and applying your data science expertise to these challenges. Ensuring that all deliverables comply with Advanced Analytics discipline governance standards and best practices is an essential aspect of your role. Additionally, your experience will be vital in mentoring and guiding less experienced team members, helping them to grow in their roles and contributing to the overall success of our team.

About the job

Tasks

Definition and development of the analytical cycle of solution evaluation:

• Ability to assess and select appropriate LLM models for each business need.
• Execution of LLM test plans, including the definition, construction and obtaining of analytical metrics (performance/cognitive, technical, and business) capable of evaluating LLMs in both discriminative and generative modes.
• The latter case is not 100% solved in the industry and requires state-of-the-art review.
• Refinement (fine-tuning) of LLM models on new domain data (discriminative and generative).
• Iterative construction of training / fine-tuning / validation datasets, evolving them based on the understanding metrics obtained and case analysis.
• Methodology approach for A/B testing and definition of requirements for experiments.
• Support for the construction and validation of KPIs.

Experimental development of analytical solutions:

• Construction of knowledge bases for the models, domain documents, unstructured information from the vertical, etc.
• Iterative construction of partial or complete analytical solutions, possibly integrating inferences from different models.
• Integration of the product and evaluation of its performance according to methodology.
• Execution of sprint-by-sprint analytical experimentation cycles.

Specialist support to the cross initiative:

• Technological prospection of advances and state of the art of current NLP (LLMs, foundational models, proprietary / open-source models, etc.).
• Experimentation support for specialized lines ( fraud, marketing, UX, talent and culture, etc.).
• Dissemination, demonstration and transmission of technical concepts suitable for different corporate profiles.

Working at BBVA

BBVA is a global company with over 160 years of history present in 25 countries with over 81 million customers. We are more than 110,000 professionals working in multidisciplinary and diverse teams. At BBVA, we are ahead of the transformation that is taking place in the banking sector, challenging the status quo, to make life easier to our customers. Being part of BBVA means developing your career in one of the most innovative companies in finance.

Responsible banking

We're committed to responsible banking to help drive a more inclusive and sustainable society . The future of banking lies in financing the future. We started out with the spirit of helping others make the best financial decisions. That spirit remains with us today and encourages us to keep moving forward, prioritizing innovation and digital transformation so that we can put the opportunities of this new era within everyone's reach.

Diversity

At BBVA we believe having a diverse team makes us a better bank. For this reason, we actively support diversity, inclusion and equal opportunities regardless race, sex, age, religion, sexual orientation, gender identity or expression. We cultivate a collaborative and inclusive work environment that allows every employee to do their best work.

Our values

Our values define our identity ; they are what drives us to make our goals a reality and they guide all of our actions and the decisions we make.

Customer comes first

We think big

We are one team