View profile

Singer has a new tap template

March 8 · Issue #12 · View online
# Introducing the new Singer tap template
We’re always looking for ways to improve the experience of building a tap, especially for first-timers. Before you start coding, you have to do a fair amount of work to set up a barebones “skeleton” of a tap. In an effort to improve the developer experience, we’ve created singer-tap-template, a cookiecutter template that attempts to make it possible to set up skeleton code for a new tap. By running half a dozen commands, described in the readme file, developers can be up and running with a new tap quickly. Thanks go to Buck Ryan, who had the original idea for this template and wrote code that we adapted for it.
Check out our Getting Started Guide for more information on working with Singer. 
# Best practices
Most APIs enforce rate limits; the Singer taps you write should respects these limits.
Rate limits can take the form of quotas (n requests per day), in which case the tap should leave room for other use of the API, or short-term limits (n requests per t seconds). For short-term limits, the entire quota can be used up and the tap should sleep when rate-limited.
The singer-python library’s utils namespace has a rate-limiting decorator you can use.
# Public roadmap updates
We’ve moved a Twitter tap from the Wishlist to the In Progress list on our public roadmap.

Ping @brian in the Slack community if you’re working on a tap we haven’t heard about yet and we’ll add it to the roadmap.
# Join the conversation
Join the Singer Slack community to chat with us and other users of Singer. Come ask questions, bounce ideas around, and make suggestions.
Singer is sponsored by Stitch, a fully managed data pipeline. With Stitch you can run Singer taps on your schedule, stream the data to your warehouse, and enjoy automated monitoring and alerting.
Did you enjoy this issue?
If you don't want these updates anymore, please unsubscribe here.
If you were forwarded this newsletter and you like it, you can subscribe here.
Powered by Revue