Valdir Stumm Junior


I'm Valdir, a Brazilian Software Engineer passionate about software development, Python, best practices and writing.

I'm a self-motivated engineer, always looking for opportunities to improve the projects I'm working on. I believe in collaboration and that's something that I'm always promoting and trying to improve in the teams I take part.

My background includes web development with Python and Django, large scale web crawling with Scrapy and years of teaching and mentoring experience.

Experience


Senior Crawling Engineer
Scrapinghub

Development of large scale web crawlers, crawling around 1.5k websites daily. The activities included crawler development, CI setup, management of servers, technical seminars, mentoring.

Experience working in a team of 15 developers spread all around the world and also as a solo developer responsible for handling a project for an important client.

Main stack: Python, Lua, Scrapy, Pandas, Docker, ScrapyRT, CircleCI, S3 and Scrapy Cloud.

2016 - Now

Software Engineer
Scrapinghub

As a software engineer in the Growth Team, I was responsible for diverse technical tasks, such as maintaining Jekyll-powered websites (scrapy.org and scrapinghub.com), setting up analytics, systems integration, contributions to Scrapy Cloud (Python & Django).

2015 - 2016

Technical Trainer
Scrapinghub

I bootstrapped the technical training program for Scrapinghub, turning it into a profitable product.

For that matter, I built and published open and reusable resources, such as the instructional videos portal and Educational material.

Besides that, I also helped promoting and educating developers about web scraping via instructional blog posts, technical articles for our products and talks/workshops in conferences and meetups.

2015 - 2017

Computer Science Teacher
Instituto Federal Catarinense

Besides teaching programming with Python and Java, I did several other activities such as development of web applications using Python & Django used by thousands of students, setup and administration of the Moodle Learning Management System and coordination of a graduation course.

2010 - 2015

Junior Developer
Federal University of Santa Maria

Worked as a developer for a large scale ERP, used by some of the biggest cities and universities in Brazil.

Main stack: Delphi, Python, Plone.

2006 - 2008

Junior SysAdmin
Federal University of Santa Maria

Support, maintenance and automation in assorted servers and services.

Main technologies: GNU/Linux, iptables, Apache, Sendmail, Bash.

2004 - 2005

Education


MSc in Computer Science

Federal University of Santa Catarina

2008 - 2010
BSc in Computer Science

Federal University of Santa Maria

2004 - 2008

Projects


  • flake8-scrapy: A Flake8 plugin to catch common issues in Scrapy spiders.
  • Python Help: A blog where I write about Python, in Portuguese.
  • DunderDoc: Another blog where I write about Python, but in English.

Open Source Contributions


  • Scrapy: A fast and efficient web crawling framework.
  • Parsel: The parsing engine behind Scrapy.
  • Shub: A command line interface to Scrapinghub services.
  • Extruct: A metadata parser for web scraping.
  • VOC: A transpiler to convert Python into Java.