Before we dive into releases, I want to highlight one fact. Python is the most used language in the Databricks platform. If you have been working in big data for some time, you have probably had this discussion at least once. Scala/Java or Python? Which language should I choose for my big data processing? ...
I have been working on an international big data project. The cluster is huge, with TBs of memory and hundreds of CPUs – another great experience in the real world of big data and parallel computing for our team. In this short article, I’d like to share a story about some lessons learned with a…
The traditional approach to quantifying credit risk in retail banking often relies on the most obvious variables such as annual/monthly income, employment length, employment title, etc. While these are still valid indicators for calculating...
As even the slowest thinkers of our current era have already recognized, social networks and related phenomena, defined in the broadest possible terms, are a great source of insight into human behaviour and preferences as well as a vital resource for data analysis and predictive modelling. The key phenomenon in predictive modelling based on social…
Graduating students hope that they will create a new recommendation system or search ranking algorithm. In reality, they have to deal with missing data, scalability and integration issues. On top of that, they have to learn the company’s processes or build new ones. It is no surprise that school is different from the working environment,…