Premium Membership ♕

Save 50% on all EEP Academy courses with Enterprise Membership Plan and study specialized LV/MV/HV technical articles & guides.

Home / Download Center / Electrical Engineering Books and Technical Guides / Power substation guides / Big data mining and analytics in substation automation and network management

Data gathered from distribution networks

This thesis begins with the study of current naming conventions used in the power systems. Two standards, the COMTRADE and the IEC 61850, that define the organizing of data are looked into. This information is used to create a novel naming convention for future use within big data mining applications.

Big data mining and analytics in substation automation and network management
Big data mining and analytics in substation automation and network management (on photo: Detailed view of the substation events and analysis reports; credit: Jonaas Puurtinen)

The main objective of this thesis is to study and test different ways to use the data gathered from distribution network more effectively. The scope of this thesis is limited to examining ways to benefit more from process data and disturbance recordings.

The goal is to develop, test and evaluate the system capable of gathering, storing, automatically analyzing the network data and visualizing the findings in an easy to read form in an actual electricity distribution network.

The practical work of this thesis was designing, programming and testing an algorithm for automated protection time calculation based on the data obtained from fault recordings.

In addition to this a novel naming convention was developed for use in future databases which utilize these automatic analyzing functions.

Current electricity distribution network architecture
Current electricity distribution network architecture

The structure

The chapter 2 addresses the state of today’s electricity distribution environment. Current power system is reviewed and the expectations for it are listed. Its basic architecture and conventions of controlling it through substation automation systems is presented.

This chapter is intended to give a baseline and motivation for which this thesis is all about. Some thoughts are given into why uninterrupted electricity distribution is so important in today’s world and how the future looks from the smart grid perspective.

When the need is established the chapter 3 moves closer into solution by giving a thorough introduction into one of the biggest phenomena affecting the automation systems – the big data mining.  In this chapter big data is given a basic definition and some ways how to benefit from it.

At the end of the Chapter 3 a scenario of how a future electricity distribution company might harness the big data to its benefit is presented.

The chapter 4 deals with the biggest problem the big data analyzing systems have to deal with, which is the diversity of the data. In this chapter baselines for using already widely accepted standards as ways to structure and standardize gathered data are discussed.

The chapter 4 describes the disturbance recording and standard defining its form as well as a novel naming convention developed specifically for automatic analyzing algorithms which bases heavily on the already widely adopted IEC 61850 standard.

In the chapter 5 the smart system analyzer concept is presented as a possible solution for big data mining in power system applications. The system components are introduced and their functions explained. At the end of this chapter a simple proof of concept testing is done in a simulated environment.

The 6th and last major chapter of this thesis covers a practical pilot testing of the system in an actual electricity distribution system. Few analyzing cases are presented with the solutions for solving them.

Finally a possible way to visualize the results is presented.

Title:Big Data Mining as Part of Substation Automation and Network management – Master of Science Thesis by PUURTINEN, JOONAS at TAMPERE UNIVERSITY OF TECHNOLOGY
Size:3.00 MB
Download:Right here | Video Courses | Membership | Download Updates
Big data mining and analytics in substation automation and network management
Big data mining and analytics in substation automation and network management

Premium Membership

Get access to premium HV/MV/LV technical articles, advanced electrical engineering guides, papers, and much more! It will help you to shape up your technical skills in your everyday life as an electrical engineer.
50% Discount 💥 - Save 50% on all 90+ video courses with Enterprise Membership plan.

More Information


  1. JL
    Jan 26, 2023

    Thanks EEP for the knowledgeable

  2. Milione Fenias Changala
    Jun 11, 2020


    The cience never goes outdated..

    Tkhs for share

  3. Mohamed Abdelatty
    Aug 15, 2018

    Thanks if your provide offer for MV PFC from specialising.

  4. Hocine Meng Fodil
    Aug 14, 2018

    Thank you very much to remember me the Technic of cut set analysis.

  5. Abhijeet P.Patil
    Aug 14, 2018

    Nice Article, very helpful for IEC61850 based substations

    Aug 14, 2018

    Nice work how to learn more

Leave a Comment

Tell us what you're thinking. We care about your opinion! Please keep in mind that comments are moderated and rel="nofollow" is in use. So, please do not use a spammy keyword or a domain as your name, or it will be deleted. Let's have a professional and meaningful conversation instead. Thanks for dropping by!

six  +  one  =  

Learn How to Design Power Systems

Learn to design LV/MV/HV power systems through professional video courses. Lifetime access. Enjoy learning!

Subscribe to Weekly Newsletter

Subscribe to our Weekly Digest newsletter and receive free updates on new technical articles, video courses and guides (PDF).
EEP Academy Courses - A hand crafted cutting-edge electrical engineering knowledge