dataset

发表于 2017-06-20 dataset producer ownership

Once upon a time, we had a single monolith of software, one mothership running everything. At SoundCloud, the proliferation of microservices came from moving fu…

Creating Readable Spark Jobs

发表于 2018-08-06 sparksession dataset spark

Nowadays, it’s rather common to encounter Apache Spark being utilized in a lot of companies that need to process huge amounts of data, and things aren’t any dif…

How (Not) to Build Datasets and Consume Data at Your Company

发表于 2020-03-03 consume dataset datasets

The topic of datasets is not new, and they have been successfully used at SoundCloud for analytics purposes for a long time. In this blog…