Blog

ai summit big data spark 2020

Spark AI Summit – what is new in the world of big data?

by Sergii Stamenov, Data Science Consultant

Before we dive into releases, I want to highlight one fact. Python is the most used language in the Databricks platform. If you have been working in big data for some time, you have probably had this discussion at least once. Scala/Java or Python? Which language should I choose for my big data processing? ...

hadoop big data with a minimal downtime

7 tips on how to fix a large amount of data in Hadoop

by Marek Sušický, Head of Big Data

I have been working on an international big data project. The cluster is huge, with TBs of memory and hundreds of CPUs – another great experience in the real world of big data and parallel computing for our team. In this short article, I’d like to share a story about some lessons learned with a…

predict client credit default with ai

Managing credit risk with advanced data analytics

by Barbora Fuksa, Business Development Manager

The traditional approach to quantifying credit risk in retail banking often relies on the most obvious variables such as annual/monthly income, employment length, employment title, etc. While these are still valid indicators for calculating...

data science project with unstructured data

The Real Challenge in Social Network Data Science

by Petr Paščenko, Head of Data Science

As even the slowest thinkers of our current era have already recognized, social networks and related phenomena, defined in the broadest possible terms, are a great source of insight into human behaviour and preferences as well as a vital resource for data analysis and predictive modelling. The key phenomenon in predictive modelling based on social…

data scientist in a project

3 Data Science Process Challenges

by Sergii Stamenov, Data Science Consultant

Graduating students hope that they will create a new recommendation system or search ranking algorithm. In reality, they have to deal with missing data, scalability and integration issues. On top of that, they have to learn the company’s processes or build new ones. It is no surprise that school is different from the working environment,…