We all know unit testing our code is a good idea. But there is some kind of inertia that keeps most of us from doing it. Part of this inertia, I believe is not knowing how to start. So I am sharing how I write tests for pyspark in the hopes that it will give you the push you need. Testing in python First things first, if you’ve never written a test for a normal python function we need to get that out of the way first.
Read More