If you’re a beginner or even if you’ve been doing it for years it’s easy to get lazy and just get by, on doing what you know. Churning out code or maintaining a creaking code base is a bit depressing, but relatively easy to do and you can plod along through that for a while. But there comes a time when it feels like you need to up your game. You can feel the technical debt racking up and you think there should be a better way to do this.
You’ve been doing small scripts for a while and you’ve started getting bigger and bigger projects. But you’re getting the fear, the dreaded imposter syndrome. Now to be fair we all get it and we all have to start somewhere. So here are a few tips to get you from somebody who does Python to a Python developer.
There has been an open data initiative in the UK since 2010 when data.gov.uk was created. After 9 years we now have a huge amount of browseable datasets on the website that can be downloaded and used for your own analysis.
One of the larger data sets available on data.gov.uk is the GP Practice prescription data coming in at around 10 million rows of data every month. This is a lot of data for your average spreadsheet to handle, so this is where tools like Pandas comes in. Pandas is a data analysis library for python that can handle many millions of rows of data and run statistical analysis on them to try and extract useful information.