Table of Contents
Power BI
Overview of Power BI
When using Microsoft Power Bi to analyse your system information there are three possible approaches
- General Information and standard reports - Use our internal PowerBi Reports (coming soon)
- Detailed Analysis with Lots of Data - Setup your own SQL Azure and PowerBi environments (you need a Microsoft Azure license and PowerBI online licenses)
- We will create a SQL database with a number of linked tables in Azure
- We will publish data to those tables regularly
- Connect PowerBI to this table set - then publish to PowerBi online
- Edit and adjust your reports in PowerBi online
- Note PowerBi can also connect to other data sources like excel online or websites to enrich the data
- Export from lists in the system regularly
- Either / or
- import these to power bi desktop then publish the results
- Load these upto excel online that Power Bi is connected to
- Either / or
Power BI is more capable than Excel Power Query in understanding the data
Reporting Tables (vbi_)
Customers = Debtors
vbi-journal lines = includes all information required for analysis of journals. Example - control line will be indicated. Every line has debit / credit / link to a GL account.
Purchase order is only the header (but joining 3 tables of different types of orders - sales, purchases, returns etc) - hence the reason for this being there
purchase order lines references purchase order table - so use this
Sales Order - no sales order lines - sales order has all the information
Stock tran item is sales order line or po line join - so use purchase order to stock tran item.
Microsoft Power Bi process
Power Bi Desktop
Use this to:
- Define the data sources and add new data sources
- Define the data conversion steps (from raw data to ready to analyse data)
- Create reports / dashboards
- This environment can do everything except allow others to view the results. To do this you must publish your report to the online environment
Power Bi Online
- An online report editor to create reports / dashboards
- Note: Can load up single tables and create reports - but not link tables together nor do data cleansing
- Online Consumption of reports
- Reports once published are accessable by users
Where Power BI can get data
One power BI model can have data from lots of places at the same time
Power Bi can accept data from many sources into a dataset as you can see here...
Connecting to SQL Azure Database
If you have setup a SQL Azure database - then you can connect from the desktop or from the online version
How to populate the Azure database from the system
Publishing the data to the Azure Database is from the Financial Period
If you connect using the onine version and your data looks funny - it might be because the database does not have "Primary Keys" setup to link the tables together. If this is the case you will have to connect via Power BI desktop to define the relationships and then publish to PowerBI online
Exporting from Lists in the system (CSV files)
Extracts from any list in the system - choose a date range etc if required.
This data will have to be refreshed by you manually into Power Bi
BI Extracts (CSV Files)
If your system has a BI Download configured - these files save as CSV with the "|" character as the delimiter
Downloaded data will have to be refreshed by you manually into Power Bi
The date sent to your datawarehouse will obe based on the date range you define.It will over-write similar data if it already exists.
Connection to a SQL Database (in Azure)
If you have large volumes of data and want regular automatic updates to it - an SQL Database is the ideal method.
The ideal place for this database is in SQL Azure - it is cheap and in the same place as Power Bi Online so data does not travel across your network for designing and refreshing the report data.
- For those that like excel it can also connect to Azure... https://blogs.technet.microsoft.com/office_online_support_blog/2015/10/29/excel-online-refreshing-data-to-a-sql-azure-database/ and https://powerbi.microsoft.com/en-us/documentation/powerbi-azure-sql-database-with-direct-connect/
We will need to set up a SQL database for you and the regular refreshes of data to it from our system.
If you connect to a database that is not in the same place (ie on your site) then every time you refresh the data in PowerBi online (it only has a complete data refresh - not an add updates) - there will be significant traffic on your network.
Data Cleansing
Once you have the data in Power Bi
You are likely to want to change headings, change data types, add columns eg calculations, etc. Most of these are similar to Excel
Column Transformations
Adding columns
An example additional column is for a bitwise operator. A bitwise operator means that a single column (OptionsProfile) contains a number that provides information about a number of different settings.
In the sample below - 32 = multiple vehicles, 64 = Favourite, 128 = Is bulk order, 16 = POD.
Review the changes made
Once you have cleansed the data you can review each step applied (it is applied again in order if you refresh the data)
Power Pivot in Excel
Power Pivot is now a separately licensed add-in to excel. If you do not see the tab - check you are licensed for it
To turn on Power Pivot in Excel
Connecting to an Azure Database
Enter the details
- Connection string
- Username
- Password
- Select a Database
Then Select the Tables Required
Select the tables to view
You can filter the tables prior to import to reduce the data
Use preview and filter above
Then import the data
Then link the tables with Relationships
Review the relationships
Then hide columns a user would not require
How hidden columns look
Save and the start creating pivot reports
Related articles