Data Engineering & Web Crawling

Company: Theklicker
Location: Palo Alto
Posted on: November 1, 2024

Job Description:

theklicker is an innovative internet technology startup focused on core mission is to connect every people on earth to e-commerce in one place. We are dedicated to theklicker values or goals and are seeking passionate and experienced Web Engineer to join our team and help shape the future of our company.
Our team is small, highly motivated, and focused on engineering excellence. This is an organization for those who appreciate challenging themselves and who thrive on curiosity. Engineers are encouraged to work across multiple areas of the company, and as a result all engineers and researchers share the title "Member of Technical Staff".
We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important.
All engineers and researchers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.
theklicker does not have recruiters. Every application is reviewed directly by a technical member of the team.
Tech Stack

• 
  
• Rust
  
• Python
  
• Spark
  
  Focus
  
  • 
    
  • Building petabyte-scale, high-throughput data processing systems.
    
  • Managing workloads across large cloud compute clusters.
    
  • Pre-processing datasets for AI training.
    
    Ideal Experience
    
    • 
      
    • Building bespoke data processing libraries from scratch.
      
    • Designing and implementing distributed systems in Rust.
      
    • Keeping up with state-of-the-art techniques for preparing AI training data.
      
    • Organizing and meticulously bookkeeping data across multiple clouds, of multiple modalities, and from many sources.
      
      Benefits
      We offer the following employee benefits:
      
      • 
        
      • Competitive cash and equity-based compensation
        
      • Medical, dental, and vision insurance
        
      • Unlimited paid time off subject to prior approval
        
        
        #J-18808-Ljbffr

Keywords: Theklicker, Hayward , Data Engineering & Web Crawling, IT / Software / Systems , Palo Alto, California