Senior data engineer (microsoft azure fabric experience required) overview we are seeking an initiative-taking sr. data engineer with expertise in azure fabric and the microsoft stack. the main goal of this role is to design, implement, and maintain cloud data solutions to collect, store, process, and transform large volumes of data into business insights for internal and customer-facing applications. the senior data engineer will build and test data pipeline architectures within azure fabric environments, identify, design, and implement internal process improvements to automate manual processes, optimize data delivery, and redesign infrastructure for greater scalability. the role focuses on data ingestion, extracting data from diverse sources, and making it available for analytics and reporting using azure fabric, python, data factory, and notebooks. essential duties and responsibilities build systems for collection and transformation of complex data sets for use in production systems. design, develop, and maintain data pipelines for reporting, optimization, and data collection. collaborate with engineers on building and maintaining back-end services. implement data schema and data management improvements for scalability and performance. develop data management solutions involving internal and external data sources. identify, design, and implement data flow and process improvements, including re-designing data infrastructure for scalability, optimizing data delivery, and automating manual processes. build data infrastructure for optimal extraction, ...
Delta solutions & strategies is seeking a system administrator at north american aerospace defense command (norad), us northern command (usnorthcom). this position will provide training support to norad, usnorthcom, and joint training, exercise and wargaming directorate (j73) with missile warning training suite (mwts) and command and control (c2) system software. **what you will be doing**: - maintain norad distributed training environment (ndte) servers, workstations, c2 systems and modeling and simulation (m&s;) tools running red hat enterprise linux and microsoft windows operating systems. - install, configure, maintain and operate ndte virtualized c2 systems within vmware vcenter server, esxi, vsphere client and workstations. - maintain and operate ndte virtualized battle control systems-fixed (bcs-f) emulating the real-world air defense sectors to feed simulated air warning data into the virtualized remote tactical air picture (rtap), stand-alone exercise global command and control system (gccs) and agile client to train norad-northcom command center (n2c2) operators and n-nc/j73 instructors within cheyenne mountain air force base and leadership. - maintain and operate ndte virtualized missile and space defense workstation processing display subsystem-migration (pds-m) virtual machines (vm). - install, configure and provide first look troubleshooting of the joint integrated ballistic missile defense/missile warning training system (jimdts) zero clients and cisco devices within cheyenne mountain space force station (cmsfs) and peterson space force base (psfb) bl...
Data engineer is responsible for designing, building, and maintaining the infrastructure and systems required for collecting, storing, and processing large datasets efficiently. **education**:bachelor's degree in computer science with 8+ years of experience **experience**: - technical skills - programming languages: proficiency in python, sql, java, or scala for data manipulation and pipeline development. - data processing frameworks: experience with tools like apache spark, hadoop, or apache kafka for large-scale data processing. - data systems and platforms - databases: knowledge of both relational databases (e.g., mysql, postgresql) and nosql databases (e.g., mongodb, cassandra). - data warehousing: experience with platforms like snowflake, amazon redshift and azure synapse. - cloud platforms: familiarity with aws, azure cloud for deploying and managing data pipelines. having good experience in fabric is advantageous - experience working with distributed computing systems such as hadoop hdfs, hive, or spark. - managing and optimizing data lakes and delta lakes for structured and unstructured data. - data modeling and architecture - expertise in designing efficient data models (e.g., star schema, snowflake schema) and maintaining data integrity. - understanding of modern data architectures like data mesh or lambda architecture. - data pipeline development - building and automating etl/elt pipelines for extracting data from diverse sources, transforming it, and loading it into target systems. - monitoring and troubleshooting pipeline performance and fai...
We are tech transformation specialists, uniting human expertise with ai to create scalable tech solutions. with over 6,500 ci&ters; around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. artificial intelligence is our reality. hello there! we are seeking an experienced senior data developer , focused on pyspark and delta lake. responsibilities: 1. implement ai tools and automation frameworks to enhance development and service delivery, ensuring efficiency and quality; 2. utilize ai-based tools to automate repetitive tasks, improve service performance, and accelerate development cycles; 3. design and implement scalable and robust microservices using python, delta lake, adb notebooks, kafka, and couchbase; 4. apply ai techniques to optimize backend architectures for speed, reliability, and efficiency; 5. take full ownership of the service lifecycle, including technical design, development, testing, and deployment; 6. ensure services are promoted to production with minimal downtime and human intervention, keeping all environments operational; 7. develop and integrate automated solutions for development, testing, deployment, and monitoring using ai-driven technologies; 8. automate unit tests, security checks, and code reviews, using ai tools to identify vulnerabilities and improve code quality; 9. work in an agile environment, contributing to sprint cycles and enhancing workflow automation; 10. use ai techniques to analyze large datasets, uncover insights, and optimize system performance and user experience; 1...
At bairesdev, we've been leading the way in technology projects for over 15 years. we deliver cutting-edge solutions to giants like google and the most innovative startups in silicon valley. our diverse 4,000+ team, composed of the world's top 1% of tech talent, works remotely on roles that drive significant impact worldwide. when you apply for this position, you're taking the first step in a process that goes beyond the ordinary. we aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. big data engineer at bairesdev big data engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different it domains such as machine learning, data analysis, mobile, web, iot, etc. they are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them. what you’ll do: - work alongside developers, tech leads, and architects to build solutions that transform users’ experience. - impact the core of business by improving existing architecture or creating new ones. - create scalable and high-availability solutions, and contribute to the key differential of each client. here is what we are looking for: - 6+ years of experience working as a developer (ruby, python, java, js, preferred). - 5+ years of experience in big data (comfortable with enterprises' big data topics such as governance, metadata m...
About truelogic at truelogic we are a leading provider of nearshore staff augmentation services headquartered in new york. for over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals. our team of 600+ highly skilled tech professionals, based in latin america, drives digital disruption by partnering with u.s. companies on their most impactful projects. whether collaborating with fortune 500 giants or scaling startups, we deliver results that make a difference. by applying for this position, you’re taking the first step in joining a dynamic team that values your expertise and aspirations. we aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future. our client at our company, we are committed to building cutting-edge solutions that drive efficiency and innovation. we thrive on a culture of continuous learning, collaboration, and proactive problem-solving. if you’re looking for a place where you can grow and make an impact, this is the team for you! job summary we are looking for a junior to semi-senior pyspark data engineer who is eager to learn, take initiative, and contribute to the development of high-performance and scalable data pipelines. this role is perfect for someone who wants to enhance their technical skills while working on exciting projects within a collaborative team. responsibilities - design, develo...
Compartir oferta compartir oferta work from home big data engineer 1886461413 at bairesdev, we've been leading the way in technology projects for over 15 years. we deliver cutting-edge solutions to giants like google and the most innovative startups in silicon valley. our diverse 4,000+ team, composed of the world's top 1% of tech talent, works remotely on roles that drive significant impact worldwide. when you apply for this position, you're taking the first step in a process that goes beyond the ordinary. we aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. big data engineers will face numerous business-impacting challenges, so they must be ready to use state of the art technologies and be familiar with different it domains such as machine learning, data analysis, mobile, web, iot, etc. they are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are truly committed to improving themselves and those around them. what you’ll do: - work alongside developers, tech leads, and architects to build solutions that transform users’ experience. - impact the core of business by improving existing architecture or creating new ones. - create scalable and high availability solutions, contribute to the key differential of each client. here's what we're looking for: - 6+ years of experience working as a developer (ruby, python, java, js, preferred). - 5+ years of experience in big data (comfortable with enterprises' big data topics such a...
About truelogic at truelogic we are a leading provider of nearshore staff augmentation services headquartered in new york. for over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals. our team of 600+ highly skilled tech professionals, based in latin america, drives digital disruption by partnering with u.s. companies on their most impactful projects. whether collaborating with fortune 500 giants or scaling startups, we deliver results that make a difference. by applying for this position, you’re taking the first step in joining a dynamic team that values your expertise and aspirations. we aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future. our client at our company, we are committed to building cutting-edge solutions that drive efficiency and innovation. we thrive on a culture of continuous learning, collaboration, and proactive problem-solving. if you’re looking for a place where you can grow and make an impact, this is the team for you! job summary we are looking for a junior to semi-senior pyspark data engineer who is eager to learn, take initiative, and contribute to the development of high-performance and scalable data pipelines. this role is perfect for someone who wants to enhance their technical skills while working on exciting projects within a collaborative team. responsibilities design, develop, and optim...
Join to apply for the lead data engineer role at athenaworks 1 week ago be among the first 25 applicants join to apply for the lead data engineer role at athenaworks join us to shape the digital world. we’re passionate about delivering cutting-edge technology to some of the world’s top startups and companies, powered by diverse and empowered teams of technologists eager to drive change. as a female-led organization, we are committed to creating a safe, inclusive space where everyone, regardless of their background, is treated with respect and equity. we value people with strong technical skills who are collaborative, curious, results-driven, and take ownership. we embrace people who want to be themselves, enjoy daily flexibility, and are eager to grow, learn, and make a difference wherever the opportunity arises if this resonates with you, we encourage you to apply for the role of lead data engineer. we're seeking exceptional talent to work on immersive client projects that will challenge and hone your skills advanced english language proficiency is required for the role. essential functions act as a key contributor to code development and review in a high-performance agile team. collaborate with engineers, product managers, and stakeholders to deliver robust, data-centric features. lead architectural decisions and ensure alignment across interfacing teams and systems. architect, deploy, and manage data solutions using tools like apache spark, airflow, databricks, among others aws services. promote technologies and practices that increase team efficiency ...
Compartir oferta compartir oferta work from home big data engineer 1886461412 at bairesdev, we've been leading the way in technology projects for over 15 years. we deliver cutting-edge solutions to giants like google and the most innovative startups in silicon valley. our diverse 4,000+ team, composed of the world's top 1% of tech talent, works remotely on roles that drive significant impact worldwide. when you apply for this position, you're taking the first step in a process that goes beyond the ordinary. we aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. big data engineers will face numerous business-impacting challenges, so they must be ready to use state of the art technologies and be familiar with different it domains such as machine learning, data analysis, mobile, web, iot, etc. they are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are truly committed to improving themselves and those around them. what you’ll do: - work alongside developers, tech leads, and architects to build solutions that transform users’ experience. - impact the core of business by improving existing architecture or creating new ones. - create scalable and high availability solutions, contribute to the key differential of each client. here's what we're looking for: - 6+ years of experience working as a developer (ruby, python, java, js, preferred). - 5+ years of experience in big data (comfortable with enterprises' big data topics such a...
At bairesdev, we've been leading the way in technology projects for over 15 years. we deliver cutting-edge solutions to giants like google and the most innovative startups in silicon valley. our diverse 4,000+ team, composed of the world's top 1% of tech talent, works remotely on roles that drive significant impact worldwide. when you apply for this position, you're taking the first step in a process that goes beyond the ordinary. we aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. big data engineer at bairesdev big data engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different it domains such as machine learning, data analysis, mobile, web, iot, etc. they are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them. what you’ll do work alongside developers, tech leads, and architects to build solutions that transform users’ experience. impact the core of business by improving existing architecture or creating new ones. create scalable and high-availability solutions, and contribute to the key differential of each client. here is what we are looking for 6+ years of experience working as a developer (ruby, python, java, js, preferred). 5+ years of experience in big data (comfortable with enterprises' big data topics such as governance, metadata management, data...
We are tech transformation specialists, uniting human expertise with ai to create scalable tech solutions. with over 6,500 ci&ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. artificial intelligence is our reality. when applying for one of our positions, you’re agreeing to the use of ai in the early phases of the selection process, where your profile will be evaluated by our virtual assistant. for more information, access our opportunities’ page. hello there! we are seeking an experienced senior data developer , focused on pyspark and delta lake. responsibilities: implement ai tools and automation frameworks to enhance development and service delivery, ensuring efficiency and quality; utilize ai-based tools to automate repetitive tasks, improve service performance, and accelerate development cycles; design and implement scalable and robust microservices using python, delta lake, adb notebooks, kafka, and couchbase; apply ai techniques to optimize backend architectures for speed, reliability, and efficiency; take full ownership of the service lifecycle, including technical design, development, testing, and deployment; ensure services are promoted to production with minimal downtime and human intervention, keeping all environments operational; develop and integrate automated solutions for development, testing, deployment, and monitoring using ai-driven technologies; automate unit tests, security checks, and code reviews, using ai tools to identify vulnerabilities and improve code quality; work in an agile environment...
We are tech transformation specialists, uniting human expertise with ai to create scalable tech solutions. with over 6,500 ci&ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. artificial intelligence is our reality. hello there! we are seeking an experienced senior data developer , focused on pyspark and delta lake. responsibilities: implement ai tools and automation frameworks to enhance development and service delivery, ensuring efficiency and quality; utilize ai-based tools to automate repetitive tasks, improve service performance, and accelerate development cycles; design and implement scalable and robust microservices using python, delta lake, adb notebooks, kafka, and couchbase; apply ai techniques to optimize backend architectures for speed, reliability, and efficiency; take full ownership of the service lifecycle, including technical design, development, testing, and deployment; ensure services are promoted to production with minimal downtime and human intervention, keeping all environments operational; develop and integrate automated solutions for development, testing, deployment, and monitoring using ai-driven technologies; automate unit tests, security checks, and code reviews, using ai tools to identify vulnerabilities and improve code quality; work in an agile environment, contributing to sprint cycles and enhancing workflow automation; use ai techniques to analyze large datasets, uncover insights, and optimize system performance and user experience; be proactive in delivering ai automation across all s...
At bairesdev, we've been leading the way in technology projects for over 15 years. we deliver cutting-edge solutions to giants like google and the most innovative startups in silicon valley. our diverse 4,000+ team, composed of the world's top 1% of tech talent, works remotely on roles that drive significant impact worldwide. when you apply for this position, you're taking the first step in a process that goes beyond the ordinary. we aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. big data engineer at bairesdev big data engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different it domains such as machine learning, data analysis, mobile, web, iot, etc. they are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them. what you’ll do: work alongside developers, tech leads, and architects to build solutions that transform users’ experience. impact the core of business by improving existing architecture or creating new ones. create scalable and high-availability solutions, and contribute to the key differential of each client. here is what we are looking for: 6+ years of experience working as a developer (ruby, python, java, js, preferred). 5+ years of experience in big data (comfortable with enterprises' big data topics such as governance, metadata management, data lineage, impa...
We are seeking an experienced data architect with a strong background in databricks to join our team and be part of innovative projects. the ideal candidate will have a deep understanding of data architecture principles, excellent analytical skills, and hands-on experience with designing and implementing data solutions using databricks. responsibilities: design and implement scalable, reliable, and efficient data architecture solutions using databricks or other platforms. collaborate with cross-functional teams to gather requirements, define data architecture strategies, and drive data initiatives. develop and maintain data models, schemas, and data pipelines to support business needs. optimize data storage, processing, and retrieval for performance and cost-effectiveness. ensure data quality, integrity, and security throughout the data lifecycle. provide technical guidance and support to data engineers, analysts, and other stakeholders. stay current with industry trends, best practices, and emerging technologies in data architecture and databricks. qualifications: bachelors or masters degree in computer science, information systems, or a related field. 5 years of experience as a data architect or a similar role. experience in it project management is preferred. proven experience with databricks, including databricks runtime, delta lake, and apache spark. strong understanding of data modeling concepts, data warehousing principles, and etl/elt processes. proficiency in sql, python, or scala for data manipulation and analysis. experience with cloud platforms such as aws, azur...
Cree una alerta de empleo y reciba nuevas ofertas que se adaptan a su perfil desde más de 2550 sitios web de empleo