Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Table of Contents

Example PowerBI reports

Image Added


Image Added

Image Added


Image Added


Image Added

Power BI

Overview of Power BI

When using Microsoft Power Bi to analyse your system information there are three possible approaches

  1. General Information and standard reports - Use our internal PowerBi Reports (coming soon)
  2. Detailed Analysis with Lots of Data - Setup your own SQL Azure and PowerBi environments
  3. We will create a SQL database with a number of linked tables in Azure
  4. We will publish data to those tables regularly
  5. Connect PowerBI to this table set - then publish to PowerBi online
  6. Edit and adjust your reports in PowerBi online
  7. Note PowerBi can also connect to other data sources like excel online or websites to enrich the dataOn system reports - On system reports are the preference for operational management reports they are accessable while you work in the system.
  8. Analytical Reports - What if, Graphical, Analysis - these reports are best in a reporting Tool like PowerBi
    1. Every night your data gets copied to a reporting data store.  The reporting data store is secure and has everything and you can build complex queries without concern about affecting the performance of the live system.
    2. Any reporting tool can be used - however the PowerBI report building tool is free.  
      1. You can author and run reports in the report building tool = but anyone with access to this tool can get to all information
    3. PowerBI publishing license
      1. We provide a single license publishing environment so you can provide online reports to report consumers.  
      2. Note additional charged licenses will be required (or you can setup your own Microsoft PowerBi licenses) if not all report consumers can see the same information.
  9. Export from lists in the system regularly
    1. Either / or
      1. import these to power bi desktop then publish the results
      2. Load these upto excel online that Power Bi is connected to

...

  1. - any grid can be exported to excel

Reporting Tables (vbi_)

Customers = Debtors

vbi-journal lines = includes all information required for analysis of journals.  Example - control line will be indicated.  Every line has debit / credit / link to a GL account.

Purchase order is only the header (but joining 3 tables of different types of orders - sales, purchases, returns etc) - hence the reason for this being there

purchase order lines references purchase order table - so use this

Sales Order - no sales order lines - sales order has all the information

Stock tran item is sales order line or po line join - so use vbi purchase order to stock tran item table (key on order id).  Stock Tran item works for both PO and SO.

vbi_item for sale = can be service or stock item, v_bi item for sale = generic both goods and services have in common, vbi_article is stock item

Projects are linked to journals – project_id is made negative, a dummy entry in orders is created to satisfy database integrity.  So project 100 would be store as order_id -100 in journals.

the link between vbi_journal_lines and orders is source_id to order_id.


Note
titleSQL Managment Studio - ssms

If you connect to the reporting using Microsofts SQL Server Management Server ( a free tool) to connect to the reporting server you will see diagrams that have been created to explain the data connections.


Microsoft Power Bi process

Gliffy
nameUsing Power Bi
pagePin3

Power Bi Desktop

Use this to:

  1. Define the data sources and add new data sources
  2. Define the data conversion steps (from raw data to ready to analyse data)
  3. Create reports / dashboards
  4. This environment can do everything except allow others to view the results.  To do this you must publish your report to the online environment

Power Bi Online

  1. An online report editor to create reports / dashboards
    1. Note: Can load up single tables and create reports - but not link tables together nor do data cleansing
  2. Online Consumption of reports
    1. Reports once published are accessable by users

Where

...

Power BI can get data

One power BI model can have data from lots of places at the same time

Power Bi can accept data from many sources into a dataset as you can see here...

Connecting to SQL Azure Database

If you have setup a SQL Azure database - then you can connect from the desktop or from the online version

How to populate the Azure database from the system

Publishing the data to the Azure Database is from the Financial Period

Image Added

Note

If you connect using the onine version and your data looks funny - it might be because the database does not have "Primary Keys" setup to link the tables together. If this is the case you will have to connect via Power BI desktop to define the relationships and then publish to PowerBI online

Exporting from Lists in the system (CSV files)

Extracts from any list in the system - choose a date range etc if required.

...

Note

This data will have to be refreshed by you manually into Power Bi

...

BI Extracts (CSV Files)

If your system has a BI Download configured - these files save as CSV with the "|" character as the delimiter

Note

This Downloaded data will have to be refreshed by you manually into Power Bi

The date sent to your datawarehouse will obe based on the date range you define.It will over-write similar data if it already exists.

Connection to a SQL Database (in Azure)

If you have large volumes of data and want regular automatic updates to it - an SQL Database is the ideal method.

The ideal place for this database is in SQL Azure - it is cheap and in the same place as Power Bi Online so data does not travel across your network for designing and refreshing the report data.

Note

We will need to set up a SQL database for you and the regular refreshes of data to it from our system.

If you connect to a database that is not in the same place (ie on your site) then every time you refresh the data in PowerBi online (it only has a complete data refresh - not an add updates) - there will be significant traffic on your network.

Data Cleansing

Once you have the data in Power Bi

You are likely to want to change headings, change data types, add columns eg calculations, etc.  Most of these are similar to Excel

Column Transformations

Adding columns

An example additional column is for a bitwise operator.  A bitwise operator means that a single column (OptionsProfile) contains a number that provides information about a number of different settings.

In the sample below - 32 = multiple vehicles, 64 = Favourite, 128 = Is bulk order, 16 = POD.  

Note

Bitwise operators are converted into readable text when using the vbi_ tables. Only when using raw database tables will you need to convert.


Review the changes made

Once you have cleansed the data you can review each step applied (it is applied again in order if you refresh the data)

Power Pivot in Excel

Power Pivot is now a separately licensed add-in to excel.  If you do not see the tab - check you are licensed for it

Image Added

To turn on Power Pivot in Excel

Image Added

Image Added

Connecting to an Azure Database

Image Added

Enter the details

  1. Connection string
  2. Username
  3. Password
  4. Select a Database


Include Page
SE:Excel Power Pivot connection details
SE:Excel Power Pivot connection details

Then Select the Tables Required

Select the tables to view

Image Added

Image Added

You can filter the tables prior to import to reduce the data

Use preview and filter above

Image Added

Then import the data

Image Added

Then link the tables with Relationships

Image Added

Review the relationships

Image AddedThen hide columns a user would not require

Image Added

How hidden columns look

Image Added

Save and the start creating pivot reports

Image Added

Filter by label (Content by label)
showLabelsfalse
max5
spacesGH
showSpacefalse
sortmodified
reversetrue
typepage
cqllabel = "admin" and type = "page" and space = "GH"
labelsadmin

Page Properties
hiddentrue


Related issues