Self-Study Day: Introduction to Data Platforms

-

Self-Study Day: Introduction to Data Platforms

Hey! So today I have a study day (with permission). While I have spent some time this morning tweaking some CSS for my current work project as I was HOOKED, I finally made it onto the actual self-study. I am going to be doing a data platform engineering course.

Obviously all work stuff is completely confidential. But anything generic I learn then this blog post will as always be my learning tool. Thanks.

Okay here we go. I'm also going on a working trip to Leeds tonight so it's intense but fabulously awesome and fun. I can't wait to do fun stuff up in Yorkshire at the weekend. And then to work from Leeds for a week. A change is as good as a rest. Got lots of exciting stuff planned in London over the next few weeks too. And now that my room is finally tidy after a year... I can dance in it again. 

And it is the best. But I'm really longing for more water tech reaserch. Need to try and fit if into my life.

What is a data platform?

I have worked with data platforms for years and never fully grasped this.

A data platform is an "ecosystem" (okay now that I DO know about) of "tools services and frameworks" that support all of the people in an organisation who work with data. Hmm.

Now that does make sense - thank you. It can include
  • Data warehouses
  • Dashboards (currently building one of those!)
  • Data transformation pipelines

What we can do with a data platform

  • Transform huge amounts of data
  • Provide accessible data transformation tools
  • Create dashboards
  • Share datasets with clients
  • Track KPIs
  • Combine data
Apparently there can be more than just one data platform within an organisation - arrrgh.

Different combinations of these tools in one data platform for different services can be known as "fabrics".

A picture representing data overall


Comments

Post a Comment

Popular posts from this blog

Hello World

-
Image
 Hello from Susanna Codes! Hi everyone,  My name is Susanna and I'm a 28-year-old aspiring software engineer from Brighton! As I type this, listening to music from "Le Fabuleux Destin d'Amelie Poulain" (it reminds me of home, in Luxembourg, where I am from - I'm missing home quite a lot lately!) and look forward to some Irish Cream tea in my afternoon break, I am thinking: How lucky I am that my amazing colleague Rosana helped me out with a plan for my software engineer journey (she directed me to the front-end first). How HTML and CSS would not have been my first languages of choice had I not been guided in this direction, as in my head they were seen as 'less-serious' langages. How done I am with what other people think of me and if other people see the 'front-end' as softer then so be it! Everyone has to start somewhere. I am so grateful to be on this journey, with Codecademy's Front-End Engineer Career Path.  Thank you to Async Brighton as ...
Read more

Where To Hide A Star

-
Image
Where To Hide A Star I haven’t read this book but I just saw this title of a forthcoming children’s book on the train and so I wanted to write a blog post based off of this as well. The last six months have been… rewarding and fulfilling. I have managed to make all of my dreams come true and to defy expectations,  Sometimes the best place to hide is in plain sight and if you reread all of my blogs over the last six months (all 200 of them) you would know exactly what I’m struggling at work and what was going on. And why. But I’ve managed to overcome most of my challenges. Neurodiversity. Being very new in the field relative to the expectations of the job. Being in a new workplace environment. All stuff which I can handle and I am doing just fine. Because I am amazing and fabulous and I can do anything. I am loving the job. I am thriving. I am loving just getting on with it. I love my work. I am having massive breakthroughs. On Thursday I had what felt like the biggest breakthrough ...
Read more

In the Water, I find Fire

-
Image
In the Water, I find Fire Who am I without renewable energy? I had to ask myself this question last year when my company laid off half its employees.  I didn’t know who I was anymore. Not without renewable energy. But I did everything I could to stay in it. The time in between jobs allowed me to experiment. Travel around the UK a bit. Reconnect with old hobbies. Rediscover my femininity a bit - be someone who wasn’t always working. But I fought to stay in renewable energy. A part of myself has been telling myself that I am in renewable energy still and that’s great because I am. But I am mostly in water. And that was hard for me to accept that. Because I love renewable energy so so much. And I couldn’t imagine my life without it. But now I can. Not because I don’t love it But because I need to give myself to something more too and that is water Because in the water I find my passion In the water, I find my fire In the water, I find my self again In the water, I find my Self So let’...
Read more