Web Crawler Developer

22 hours ago

Brisbane, Queensland, Australia beBeeWebCrawler Full time $80,000 - $160,000
Job Description

We are looking for a talented Web Crawler Developer to join our team. As a key member of our development team, you will be responsible for designing and implementing efficient web crawlers to extract valuable data from public websites.

The ideal candidate will have experience in Python, especially in web scraping, and a strong understanding of software development fundamentals. You will work closely with our backend development team to integrate crawler services into our platform.

Key Responsibilities:

  • Develop and maintain web crawlers using Python libraries such as requests, BeautifulSoup, and Scrapy
  • Optimize and improve existing crawler architecture for performance and reliability
  • Collaborate with the backend development team to integrate crawler services into our platform
  • Write clean, maintainable, and well-documented code
  • Participate in code reviews and team discussions

Requirements:

  • Experience in Python, especially in web scraping (e.g., requests, BeautifulSoup, Selenium, Scrapy)
  • Understanding of Java and Spring Boot, with the ability to read and write backend service code
  • Familiarity with SQL syntax; experience with MySQL or PostgreSQL is a plus
  • Familiarity with software development fundamentals: version control (Git), REST APIs, modular code design
  • Strong problem-solving skills and a logical mindset
  • Willingness to learn, communicate, and take ownership of tasks

Preferred Qualifications:

  • Personal or academic projects related to web crawling or backend services (GitHub or portfolio links are welcome)
  • Experience with data processing libraries such as pandas, json, and regular expressions
  • Familiarity with Docker, AWS, or cloud-native tools is a big plus

Benefits

By joining us, you will have the opportunity to work with cutting-edge technologies and contribute to shaping the future of blockchain and finance.

  • Senior Software Engineer

    6 days ago

    Brisbane, Queensland, Australia beBeeWebCrawler Full time $150,000 - $220,000

    Software Engineering Web Crawler JobThe role involves developing web crawlers to extract valuable information from public websites and optimizing existing crawler architecture for improved performance and reliability.Candidates should have experience in Python, especially with web scraping libraries such as requests and BeautifulSoup. Knowledge of Java and...

  • Senior Web Data Extraction Specialist

    3 days ago

    Brisbane, Queensland, Australia beBeeWebDataExtraction Full time $100,000 - $170,000

    We are seeking a skilled web data extraction specialist to join our team. The ideal candidate will be passionate about software engineering and have experience with Python and Java Spring Boot.Responsibilities:Develop and maintain web crawlers to extract useful data from public websitesOptimize and improve existing crawler architecture for performance and...

  • Cloud Software Developer

    7 days ago

    Brisbane, Queensland, Australia beBeeWeb Full time $100,000 - $140,000

    Software EngineerBinance, a leading global blockchain ecosystem, is seeking a motivated software engineer to join its team. As a member of our engineering team, you will have the opportunity to work on exciting projects and develop your skills in software engineering.This is an excellent chance to grow quickly in a fast-paced, supportive environment that...

  • Career Opportunities Software Engineering

    1 week ago

    Brisbane, Queensland, Australia beBeeEngineer Full time $80,000 - $165,000

    Software Engineer Job DescriptionWe are seeking a motivated software engineer who is passionate about web data extraction and backend development.This role involves developing and maintaining web crawlers to extract useful data from public websites, optimizing crawler architecture for performance and reliability, and collaborating on backend development to...

  • Senior Software Engineer

    1 week ago

    Brisbane, Queensland, Australia beBeeSoftwareEngineer Full time $120,000 - $170,000

    We are seeking a motivated and passionate software engineer to join our team. As part of our engineering team, you will be responsible for developing and maintaining web crawlers to extract useful data from public websites.Key Responsibilities:Develop and maintain high-performance web crawlers using Python or Java Spring BootOptimize existing crawler...

  • Accelerator Program Specialist

    4 days ago

    Brisbane, Queensland, Australia beBeeSoftware Full time $100,000 - $170,000

    Job Opportunity: Accelerator Program SpecialistWe are seeking a highly skilled software engineer to develop and maintain web crawlers that extract valuable data from public websites. This is an exciting opportunity for a motivated individual who is passionate about coding, problem-solving, and delivering high-quality results.About the Role:Design and...

  • Data Extraction Specialist

    4 days ago

    Brisbane, Queensland, Australia beBeeSoftware Full time $90,000 - $120,000

    Job Description:Binance is a leading blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 280 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset...

  • Web Application Developer

    1 week ago

    Brisbane, Queensland, Australia beBeeWebDeveloper Full time $60,000 - $95,500

    Web Application Specialist Job DescriptionWe are seeking a skilled Web Application Specialist to join our team. As a key member of our digital development team, you will play a crucial role in designing and maintaining websites that meet the needs of our users.The ideal candidate will have a solid understanding of web programming languages, including HTML,...

  • Accelerator Program

    3 weeks ago

    Brisbane, Queensland, Australia Binance Full time

    Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 280 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance...

  • Accelerator Program

    1 day ago

    Brisbane, Queensland, Australia Binance Full time

    Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users.We are trusted by over 280 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products.Binance...