ODTUG Aggregator ODTUG Blogs http://localhost:8080 Tue, 20 Feb 2018 16:29:03 +0000 http://aggrssgator.com/ ODTUG Kscope Community Service Day Renamed to Honor Its Founder https://www.odtug.com/p/bl/et/blogaid=769&source=1 ODTUG Community Service Day Renamed ‘Kathleen McCasland Community Service Day’. User group honors its founder and reflects on past 10 years of community service across the nation. ODTUG https://www.odtug.com/p/bl/et/blogaid=769&source=1 Tue Feb 20 2018 14:07:41 GMT-0500 (EST) Direct-Path INSERT and NOLOGGING with Oracle 12.2 https://danischnider.wordpress.com/2018/02/20/direct-path-insert-and-nologging-with-oracle-12-2/ <p>Direct-Path INSERT is a very efficient way to load data into data warehouse tables. The load performance can even be improved with NOLOGGING on the target table. In Oracle 12c Release 2, this is even possible for Oracle Data Guard environments. But is it a good idea?</p> <p><span id="more-552"></span></p> <p>One of the new features in Oracle 12.2 is the support of NOLOGGING in Oracle Data Guard. The title of this enhancement in the new features documentation is “<a href="https://docs.oracle.com/en/database/oracle/oracle-database/12.2/newft/new-features.html#GUID-A407AADA-F924-40A3-8959-78DB9568A552">Oracle Data Guard for Data Warehouses</a>”. What is the benefit of this feature, and how useful is it for data warehouses? To explain this, let’s first look at two important database features for data warehousing that are available since years: <em>Direct-Path INSERT</em> and <em>NOLOGGING</em>.</p> <h1>Direct-Path INSERT</h1> <p>A very efficient way to load data into a table is <em>Direct-Path INSERT</em>. Unlike a conventional INSERT, new rows are not applied to the database buffer cache row by row, but written directly to the data files in new data blocks at the end of the table. Because a Direct-Path INSERT bypasses the space management to reuse free space in the existing blocks, it is much faster to insert multiple rows into a target table. It is highly recommended to use Direct-Path INSERT for loading large data sets into a data warehouse database.</p> <p>The drawback of this feature is that free space in existing table blocks is not used for the new data. For example, if existing rows were deleted (which usually does not occur in a data warehouse), the free parts in the table block are lost and cannot be reused for new rows. This is also the case for the last block of a Direct-Path INSERT. The free space after the last row will not be used anymore for the next Direct-Path INSERT, because then a new block will be written. For ETL jobs that insert only very few rows at a time, a conventional INSERT is a better choice. But for ETL jobs that load a large amount of rows, for example a daily load into a fact table, the advantage of better load performance is much more important than the (small) loss of empty space in the blocks.</p> <p><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">Direct-Path INSERT is used in the following situations:</span></p> <ul> <li><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">When an <em>append</em> hint is added to an INSERT or MERGE statement</span></li> <li><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">When an <em>append_values</em> hint is added to a PL/SQL FORALL statement</span></li> <li><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">When an INSERT statement is executed with <em>Parallel DML</em></span></li> <li><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">When a CREATE TABLE AS SELECT is executed</span></li> </ul> <div><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">This very simple example shows how a fact table FACT_SALES can be loaded from a stage table STAGE_SALES with a Direct-Path INSERT, using an <em>append</em> hint:</span></div> <div> </div> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;"><br /></span>INSERT /*+ append */ INTO fact_sales<br />SELECT * from stage_sales;<br /> <br />100&#8217;000 rows inserted.<br /> <br />Elapsed: 00:00:00.938</p> <p><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;"><br /></span></p> <p><span style="color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;">There are several restrictions with Direct-Path INSERT that must be considered. Further information can be found in the <a href="https://docs.oracle.com/en/database/oracle/oracle-database/12.2/sqlrf/INSERT.html#GUID-903F8043-0254-4EE9-ACC1-CB8AC0AF3423">SQL Language Reference</a> and in the <a href="https://docs.oracle.com/en/database/oracle/oracle-database/12.2/admin/managing-tables.html#GUID-7B5676FC-59B4-418F-826B-8F4D7E3690E2">Database Administrator’s Guide</a> of the Oracle documentation.</span></p> <h1>The Impact of NOLOGGING</h1> <p>The load performance of Direct-Path INSERT can be improved when the target table is set to NOLOGGING, as shown in the following example:</p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;min-height:14px;"> </p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">ALTER TABLE fact_sales NOLOGGING;</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"> </p> <p> </p> <p>Here a short summary what this setting means and when it takes place:</p> <ul> <li>When a target table is set to NOLOGGING, only minimal redo log information is written during a Direct-Load INSERT. This reduces the load time of large data loads because no overhead for redo logging is used anymore.</li> <li>For any other DML statements, i.e. conventional INSERT, UPDATE or DELETE statements, NOLOGGING has <span style="text-decoration:underline;">no impact</span> at all. In all these cases, the normal redo logging mechanism is used, independent whether the target table is set no LOGGING or NOLOGGING.</li> <li>If the database is set to FORCE LOGGING (which must be the case in a Data Guard environment), the NOLOGGING parameter is ignored, i.e. normal redo log information is written even for Direct-Load INSERT.</li> </ul> <p>The combination of Direct-Path INSERT and NOLOGGING supports a very efficient load performance. But the price for it is that you are not able to recover lost data from the archive redo log files. This sounds dramatically, but for many data warehouses, this is not a real issue. As long as the data can be reloaded from the source systems, from delivered flat files or from a preceding data warehouse layer (e.g. a persistent staging area), setting all target tables to NOLOGGING is a feasible and often used option.</p> <blockquote> <p><strong><em>Real Life Story:</em></strong></p> <p><em>In a data warehouse of my first customer at Trivadis, we created all tables in the DWH database with NOLOGGING. This improved the ETL performance dramatically, and in this case it was possible because all data of the nightly loads was delivered in flat files. After loading these files into the staging area of the data warehouse, the files were moved to an archive directory on the file system.</em></p> <p><em>One day, the “worst case scenario” happened. One of the developers (fortunately it was not me) started a schema cleanup script on the wrong database and dropped all fact tables in the production database instead of the test environment. Oops… Because of the NOLOGGING setting of all target tables, a point-in-time recovery was not possible. So, the DBA had to restore the last full backup, and then we had to reload all data since the last backup from the archived flat files. The accident happened on a Thursday evening, the whole night and Friday was used to restore the database from the backup tapes of Tuesday. On Saturday morning we were able to start reloading the missing data (Tuesday to Saturday), and on Monday morning, the system was online again. So, we were lucky that the system was offline only one working day (Friday).</em></p> </blockquote> <p>But even when it is possible to reload the data from files or any other sources, there is still another restriction with NOLOGGING; When Oracle Data Guard is in place, the redo log information is used to apply all data changes from the primary database to the standby database. If some of the tables on the primary database are set to NOLOGGING, this is not possible. Therefore, it is highly recommended to run the primary database in FORCE LOGGING mode. Or in other words: If a data warehouse is installed on an Oracle Data Guard environment, NOLOGGING cannot be used to improve load performance.</p> <h1>Oracle Data Guard and NOLOGGING in Oracle 12.2</h1> <p>In Oracle 12c Release 2, a new mechanism has been introduced in Oracle Data Guard. Blocks written by NOLOGGING operations on the primary database are recorded in the control file of the physical standby database and can be recovered with a new RMAN command: <em>RECOVER DATABASE NONLOGGED BLOCK</em>. Details about this scenario are described in the <a href="https://docs.oracle.com/en/database/oracle/oracle-database/12.2/sbydb/examples-of-using-oracle-data-guard.html#GUID-BB804A80-7F19-4087-BAFA-97552C1DAAEF">Oracle Data Guard Concepts and Administration</a> manual.</p> <p>Franck Pachot did some tests of this feature and explained the results in his blog post <a href="https://blog.dbi-services.com/12cr2-recover-nonlogged-blocks-after-nologging-in-data-guard/">12cR2: Recover nonlogged blocks after NOLOGGING in Data Guard</a>. His recommendation: As long as a recovery of the non-logged blocks is done on the standby database directly after the NOLOGGING operation on the primary database, the features is “acceptable”.</p> <p>When I read the sparse information in the Oracle 12.2 documentation and the comments of Franck’s blog post, I’m not sure whether I would recommend to use Direct-Path INSERT with NOLOGGING for a data warehouse in an Oracle Data Guard environment. Although it is possible to apply the non-logged blocks on a physical standby database, a lot of details have to be considered to avoid bad surprises in case of a media failure or a switchover. So, if you plan to use this feature in your data warehouse, it is important to evaluate the pros and cons of this configuration.</p> <p>My recommendations are:</p> <ul> <li>Use <em>Direct-Path INSERT </em>in your ETL processes to improve load performance of large data sets. See tip 9 in my blog post <a href="//danischnider.wordpress.com/2017/07/23/10-tips-to-improve-etl-performance/">10 Tips to Improve ETL Performance</a>.</li> <li>If data can be reloaded from the source systems, flat files or previous DWH layers, the tables can additionally be configured with <em>NOLOGGING </em>&#8211; if you are not on Oracle Data Guard.</li> <li>For Data Guard on Oracle 12.2, you can use <em>NOLOGGING</em>. But check carefully the impact on all levels (performance, high availability, backup/recovery) with all involved parties (DWH architects, ETL developers, database administrators).</li> </ul> <div style="box-sizing:border-box;color:#333333;font-family:'Helvetica Neue', 'Segoe UI', Roboto, sans-serif-regular, sans-serif;font-size:14px;"> <p style="box-sizing:border-box;margin:14px 0;"> </p> </div> Dani Schnider http://danischnider.wordpress.com/?p=552 Tue Feb 20 2018 04:49:38 GMT-0500 (EST) Spring into action with our new OBIEE 12c Systems Management & Security On Demand Training course http://www.rittmanmead.com/blog/2018/02/on-demand-training-new-course-obiee-12c-systems-management/ <p>Rittman Mead are happy to release a new course to the <a href="https://learn.rittmanmead.com">On Demand Training</a> platform. </p> <p>The <strong>OBIEE 12c Systems Management &amp; Security</strong> course is the essential learning tool for any developers or administrators who will be working on the maintenance &amp; optimisation of their OBIEE platform. </p> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/02/Screen-Shot-2018-02-19-at-11.08.16.png" alt="Baseline Validation Tool"></p> <p>View lessons and live demos from our experts on the following subjects:</p> <ul> <li>What's new in OBIEE 12c</li> <li>Starting &amp; Stopping Services</li> <li>Managing Metadata</li> <li>System Preferences</li> <li>Troubleshooting Issues</li> <li>Caching</li> <li>Usage Tracking</li> <li>Baseline Validation Tool</li> <li>Direct Database Request</li> <li>Write Back</li> <li>LDAP Users &amp; Groups</li> <li>Application Roles</li> <li>Permissions</li> </ul> <p><strong>Get hands on</strong> with the <strong>practical version</strong> of the course which comes with an <strong>OBIEE 12c training environment and 9 lab exercises.</strong> <br> <img src="http://www.rittmanmead.com/blog/content/images/2018/02/Screen-Shot-2018-02-19-at-11.21.11.png" alt="System Preferences"></p> <p>Rittman Mead will also be releasing a <strong>theory version</strong> of the course. This will not include the lab exercises but gives each of the lessons and demos that you'd get as part of the practical course. </p> <p><strong>Course prices are as follows:</strong></p> <p><strong><em>OBIEE 12c Systems Management &amp; Security - PRACTICAL - $499</em></strong></p> <ul> <li>30 days access to lessons &amp; demos</li> <li>30 days access to OBIEE 12c training environment for lab exercises</li> <li>30 days access to Rittman Mead knowledge base for Q&amp;A and lab support</li> </ul> <p><strong><em>OBIEE 12c Systems Management &amp; Security - THEROY - $299</em></strong></p> <ul> <li>30 days access to lessons &amp; demos</li> <li>30 days access to Rittman Mead knowledge base for Q&amp;A</li> </ul> <p>To celebrate the changing of seasons we suggest you <strong>Spring into action with OBIEE 12c</strong> by receiving a <strong>25% discount</strong> on both courses until <strong>31st March 2018</strong> using voucher code:</p> <h1 id="odtspring18">ODTSPRING18</h1> <p>Access both courses and the rest of our catalog at <a href="https://learn.rittmanmead.com">learn.rittmanmead.com</a></p> Sam Jeremiah 3c6d0a9b-67ea-4df8-84ff-29586fc7c00a Mon Feb 19 2018 06:49:00 GMT-0500 (EST) 18c is now available (but only on the Cloud) http://www.oralytics.com/2018/02/18c-is-now-available-but-only-on-cloud.html <p>On Friday afternoon (16th February) we started to see tweets and blog posts from people in Oracle saying that Oracle 18c was now available. But is only available on Oracle Cloud and Engineered Systems. </p> <p>It looks like we will have to wait until the Autumn before we can install it ourselves on our own servers :-(</p> <p>Here is the link to the official announcement for <a href="https://blogs.oracle.com/database/oracle-database-18c-%3a-now-available-on-the-oracle-cloud-and-oracle-engineered-systems" target="_blank">Oracle 18c</a>.</p> Oracle 18c is really Oracle 12.2.0.2. The next full new release of the Oracle database is expected to be Oracle 19. <p>The new features and incremental enhancements in Oracle 18c are:</p> <ul> <li>Multitenant</li> <li>In-Memory</li> <li>Sharding</li> <li>Memory Optimized Fetches</li> <li>Exadata RAC Optimizations</li> <li>High Availability</li> <li>Security</li> <li>Online Partition Merge</li> <li>Improved Machine Learning (OAA)</li> <li>Polymorphic Table Functions</li> <li>Spatial and Graph</li> <li>More JSON improvements</li> <li>Private Temporary Tablespaces</li> <li>New mode for Connection Manager</li></ul> <p>And now the all important links to the documentation.</p> <p><a href="https://docs.oracle.com/en/database/oracle/oracle-database/18/index.html" target="_blank">Oracle 18c Documentation</a></p><p><a href="https://docs.oracle.com/en/database/oracle/oracle-database/18/newft/new-features.html#GUID-04A4834D-848F-44D5-8C34-36237D40F194" target="_blank">Oracle 18c New Features</a></p><p><a href="https://docs.oracle.com/en/database/oracle/oracle-database/18/data-warehousing.html" target="_blank">Oracle 18c Data Warehousing</a></p> <p>To give Oracle 18c a try you will need to go to <a href="https://cloud.oracle.com/en_US/database" target="_blank">cloud.oracle.com</a> and select Database from the drop down list from the Platform menu. Yes you are going to need an Oracle Cloud account and some money or some free credit. Go and get some free cloud credits at the upcoming <a href="https://developer.oracle.com/code" target="_blank">Oracle Code events</a>.</p> <p>If you want a 'free' way of trying out Oracle 18c, you can use <a href="https://livesql.oracle.com/" target="_blank">Oracle Live SQL</a>. They have setup some examples of the new features for you to try.</p> <a href="https://livesql.oracle.com/" target="_blank"><img src="https://lh3.googleusercontent.com/-i621nIYY11I/WoliHGLj4_I/AAAAAAAAMSo/-v0GO7l78psaKk--no4zWRmR7rSRWWLJwCHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="599" height="439" /></a> <p>NOTE: Oracle 18c is not Autonomous. Check out <a href="https://oracle-base.com/blog/2018/01/05/oracle-database-18c-is-not-an-autonomous-database-update/" target="_blank">Tim Hall's blog posts about this</a>. The Autonomous Oracle Database is something different, and we will be hearing more about this going forward.</p> Brendan Tierney tag:blogger.com,1999:blog-4669933501315263808.post-2601911893584143732 Sun Feb 18 2018 06:32:00 GMT-0500 (EST) Putting OAC Data Sync 2.4 Through the EssCS Paces https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/ <p>When I saw that Data Sync 2.4 for OAC was released this morning, I decided to test the data load process to an EssCS cube. I hoped it would be a straightforward process, but – in all honesty – it took me 2 ½ hours to get it up and loading. Below are some of the steps and missteps I took to installing and using Data Sync 2.4…</p> <p>First, I downloaded the file from: <a href="https://t.co/o0eR3HII7x"> https://t.co/o0eR3HII7x</a> . …That part is straightforward.</p> <p>I extracted it to my location of choice (full disclosure…I ran into some issues so I changed my extract location a couple times until I figured out the issue. So, if you see different install folders, you will know why!).</p> <p>Because my VM was new, I had never set the JAVA_HOME environment variable. Of note, for OAC Data Sync, you must reference the JDK installation. JRE is not going to work!</p> <p>In the config.bat file, edit the JAVA_HOME to the location you just created in Environment Variables.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0011.png"><img data-attachment-id="1995" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0011-7/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=840&#038;h=574" data-orig-size="870,594" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0011" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=840&#038;h=574?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=840&#038;h=574?w=840" class="alignnone size-full wp-image-1995" src="https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=840&#038;h=574" alt="" width="840" height="574" srcset="https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=840&amp;h=574 840w, https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=150&amp;h=102 150w, https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=300&amp;h=205 300w, https://epmqueen.files.wordpress.com/2018/02/image0011.png?w=768&amp;h=524 768w, https://epmqueen.files.wordpress.com/2018/02/image0011.png 870w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Here is where I lost a LOT of time. I could NOT get Data Sync to start! The batch file would close and no Java application would open. I put a pause at the end of the datasync.bat file to see what the errors were… What I got was:</p> <p><strong>Error: Could not find or load main class com.siebel.analytics.etl.client.view.EtlViewsInitializer Replication </strong></p> <p>Now, I am no Java expert (a novice’s novice, perhaps, at BEST) so I did a LOT of research. I saw that the Java class could not be found, which is held in a path using the DACCLASSPATH variable.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0021.png"><img data-attachment-id="1996" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0021-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0021.png?w=840" data-orig-size="759,392" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0021" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0021.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0021.png?w=840?w=759" class="alignnone size-full wp-image-1996" src="https://epmqueen.files.wordpress.com/2018/02/image0021.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0021.png 759w, https://epmqueen.files.wordpress.com/2018/02/image0021.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0021.png?w=300 300w" sizes="(max-width: 759px) 100vw, 759px" /></a></p> <p>The config.bat file is where the DACCLASSPATH is set.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0031.png"><img data-attachment-id="1997" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0031-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=840&#038;h=578" data-orig-size="880,605" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0031" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=840&#038;h=578?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=840&#038;h=578?w=840" class="alignnone size-full wp-image-1997" src="https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=840&#038;h=578" alt="" width="840" height="578" srcset="https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=840&amp;h=578 840w, https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=150&amp;h=103 150w, https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=300&amp;h=206 300w, https://epmqueen.files.wordpress.com/2018/02/image0031.png?w=768&amp;h=528 768w, https://epmqueen.files.wordpress.com/2018/02/image0031.png 880w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>So I added the full file path:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0041.png"><img data-attachment-id="1998" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0041-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0041.png?w=840" data-orig-size="731,459" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0041" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0041.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0041.png?w=840?w=731" class="alignnone size-full wp-image-1998" src="https://epmqueen.files.wordpress.com/2018/02/image0041.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0041.png 731w, https://epmqueen.files.wordpress.com/2018/02/image0041.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0041.png?w=300 300w" sizes="(max-width: 731px) 100vw, 731px" /></a></p> <p>In fact, I added it to every location in each batch script referencing config.bat, like the following:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0051.png"><img data-attachment-id="1999" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0051-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=840" data-orig-size="799,355" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0051" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=840?w=799" class="alignnone size-full wp-image-1999" src="https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0051.png 799w, https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image0051.png?w=768 768w" sizes="(max-width: 799px) 100vw, 799px" /></a></p> <p>Once I updated each batch file, I ran the datasync.bat script to create the Data Sync environment.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0061.png"><img data-attachment-id="2000" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0061-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0061.png?w=840" data-orig-size="549,542" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0061" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0061.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0061.png?w=840?w=549" class="alignnone size-full wp-image-2000" src="https://epmqueen.files.wordpress.com/2018/02/image0061.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0061.png 549w, https://epmqueen.files.wordpress.com/2018/02/image0061.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0061.png?w=300 300w" sizes="(max-width: 549px) 100vw, 549px" /></a></p> <p>I missed the screenshot on this one…where you choose between creating a new environment or connecting to a previous one, but I chose to create a new one.</p> <p>Next, you are asked to create a password for DS:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0071.png"><img data-attachment-id="2001" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0071-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0071.png?w=840" data-orig-size="581,390" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0071" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0071.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0071.png?w=840?w=581" class="alignnone size-full wp-image-2001" src="https://epmqueen.files.wordpress.com/2018/02/image0071.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0071.png 581w, https://epmqueen.files.wordpress.com/2018/02/image0071.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0071.png?w=300 300w" sizes="(max-width: 581px) 100vw, 581px" /></a></p> <p>You will wait a few seconds for the files to create before you get an all clear.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0081.png"><img data-attachment-id="2002" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0081-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0081.png?w=840" data-orig-size="579,390" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0081" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0081.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0081.png?w=840?w=579" class="alignnone size-full wp-image-2002" src="https://epmqueen.files.wordpress.com/2018/02/image0081.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0081.png 579w, https://epmqueen.files.wordpress.com/2018/02/image0081.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0081.png?w=300 300w" sizes="(max-width: 579px) 100vw, 579px" /></a></p> <p>Next, you will run datasyncClient.bat to start setting up the actual data synchronizations.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0091.png"><img data-attachment-id="2003" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0091-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0091.png?w=840" data-orig-size="449,549" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0091" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0091.png?w=840?w=245" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0091.png?w=840?w=449" class="alignnone size-full wp-image-2003" src="https://epmqueen.files.wordpress.com/2018/02/image0091.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0091.png 449w, https://epmqueen.files.wordpress.com/2018/02/image0091.png?w=123 123w, https://epmqueen.files.wordpress.com/2018/02/image0091.png?w=245 245w" sizes="(max-width: 449px) 100vw, 449px" /></a></p> <p>If you chose to save the password earlier, it will be entered for you. Otherwise, enter the password.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0101.png"><img data-attachment-id="2004" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0101-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0101.png?w=840" data-orig-size="582,391" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0101" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0101.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0101.png?w=840?w=582" class="alignnone size-full wp-image-2004" src="https://epmqueen.files.wordpress.com/2018/02/image0101.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0101.png 582w, https://epmqueen.files.wordpress.com/2018/02/image0101.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0101.png?w=300 300w" sizes="(max-width: 582px) 100vw, 582px" /></a></p> <p>I wanted to create a new Project (data synchronization between an Excel file and EssCS) so I gave it a name:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0111.png"><img data-attachment-id="2005" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0111-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0111.png?w=840" data-orig-size="551,377" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0111" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0111.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0111.png?w=840?w=551" class="alignnone size-full wp-image-2005" src="https://epmqueen.files.wordpress.com/2018/02/image0111.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0111.png 551w, https://epmqueen.files.wordpress.com/2018/02/image0111.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0111.png?w=300 300w" sizes="(max-width: 551px) 100vw, 551px" /></a></p> <p>The first thing I needed to do was create my connection to EssCS. Note that the URL is <a href="http://ipaddress:9000/">http://ipaddress:9000/</a></p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image0121.png"><img data-attachment-id="2006" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image0121-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=840" data-orig-size="773,760" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0121" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=840?w=773" class="alignnone size-full wp-image-2006" src="https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image0121.png 773w, https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image0121.png?w=768 768w" sizes="(max-width: 773px) 100vw, 773px" /></a></p> <p>My connection tested successfully, so I’m good to move on.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image013.png"><img data-attachment-id="2007" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image013-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image013.png?w=840&#038;h=508" data-orig-size="1145,693" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image013" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image013.png?w=840&#038;h=508?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image013.png?w=840&#038;h=508?w=840" class="alignnone size-full wp-image-2007" src="https://epmqueen.files.wordpress.com/2018/02/image013.png?w=840&#038;h=508" alt="" width="840" height="508" srcset="https://epmqueen.files.wordpress.com/2018/02/image013.png?w=840&amp;h=508 840w, https://epmqueen.files.wordpress.com/2018/02/image013.png?w=150&amp;h=91 150w, https://epmqueen.files.wordpress.com/2018/02/image013.png?w=300&amp;h=182 300w, https://epmqueen.files.wordpress.com/2018/02/image013.png?w=768&amp;h=465 768w, https://epmqueen.files.wordpress.com/2018/02/image013.png?w=1024&amp;h=620 1024w, https://epmqueen.files.wordpress.com/2018/02/image013.png 1145w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>On the Project tab under Source Data, I am choosing Data from Object(s) as it’s an Excel file. So I set the location of my Excel file.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image014.png"><img data-attachment-id="2008" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image014-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image014.png?w=840&#038;h=512" data-orig-size="1085,661" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image014" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image014.png?w=840&#038;h=512?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image014.png?w=840&#038;h=512?w=840" class="alignnone size-full wp-image-2008" src="https://epmqueen.files.wordpress.com/2018/02/image014.png?w=840&#038;h=512" alt="" width="840" height="512" srcset="https://epmqueen.files.wordpress.com/2018/02/image014.png?w=840&amp;h=512 840w, https://epmqueen.files.wordpress.com/2018/02/image014.png?w=150&amp;h=91 150w, https://epmqueen.files.wordpress.com/2018/02/image014.png?w=300&amp;h=183 300w, https://epmqueen.files.wordpress.com/2018/02/image014.png?w=768&amp;h=468 768w, https://epmqueen.files.wordpress.com/2018/02/image014.png?w=1024&amp;h=624 1024w, https://epmqueen.files.wordpress.com/2018/02/image014.png 1085w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>I am testing with just one record so I set the parameters as such:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image015.png"><img data-attachment-id="2009" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image015-9/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image015.png?w=840" data-orig-size="512,360" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image015" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image015.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image015.png?w=840?w=512" class="alignnone size-full wp-image-2009" src="https://epmqueen.files.wordpress.com/2018/02/image015.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image015.png 512w, https://epmqueen.files.wordpress.com/2018/02/image015.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image015.png?w=300 300w" sizes="(max-width: 512px) 100vw, 512px" /></a></p> <p>I created a new “Target” name…aptly “TestLoad”.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image016.png"><img data-attachment-id="2010" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image016-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image016.png?w=840" data-orig-size="507,357" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image016" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image016.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image016.png?w=840?w=507" class="alignnone size-full wp-image-2010" src="https://epmqueen.files.wordpress.com/2018/02/image016.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image016.png 507w, https://epmqueen.files.wordpress.com/2018/02/image016.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image016.png?w=300 300w" sizes="(max-width: 507px) 100vw, 507px" /></a></p> <p>Next, it renames my column headers to more relational database friendly names.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image017.png"><img data-attachment-id="2011" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image017-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image017.png?w=840&#038;h=368" data-orig-size="1123,492" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image017" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image017.png?w=840&#038;h=368?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image017.png?w=840&#038;h=368?w=840" class="alignnone size-full wp-image-2011" src="https://epmqueen.files.wordpress.com/2018/02/image017.png?w=840&#038;h=368" alt="" width="840" height="368" srcset="https://epmqueen.files.wordpress.com/2018/02/image017.png?w=840&amp;h=368 840w, https://epmqueen.files.wordpress.com/2018/02/image017.png?w=150&amp;h=66 150w, https://epmqueen.files.wordpress.com/2018/02/image017.png?w=300&amp;h=131 300w, https://epmqueen.files.wordpress.com/2018/02/image017.png?w=768&amp;h=336 768w, https://epmqueen.files.wordpress.com/2018/02/image017.png?w=1024&amp;h=449 1024w, https://epmqueen.files.wordpress.com/2018/02/image017.png 1123w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Again, full honesty, while testing why my loads kept failing, I changed my relational column names. Same process though…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image018.png"><img data-attachment-id="2012" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image018-9/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image018.png?w=840&#038;h=408" data-orig-size="1665,809" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image018" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image018.png?w=840&#038;h=408?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image018.png?w=840&#038;h=408?w=840" class="alignnone size-full wp-image-2012" src="https://epmqueen.files.wordpress.com/2018/02/image018.png?w=840&#038;h=408" alt="" width="840" height="408" srcset="https://epmqueen.files.wordpress.com/2018/02/image018.png?w=840&amp;h=408 840w, https://epmqueen.files.wordpress.com/2018/02/image018.png?w=150&amp;h=73 150w, https://epmqueen.files.wordpress.com/2018/02/image018.png?w=300&amp;h=146 300w, https://epmqueen.files.wordpress.com/2018/02/image018.png?w=768&amp;h=373 768w, https://epmqueen.files.wordpress.com/2018/02/image018.png?w=1024&amp;h=498 1024w, https://epmqueen.files.wordpress.com/2018/02/image018.png 1665w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>This part is crucial! On the “Target Objects” tab, you need to fill out the requisite details including Application, Cube, and Rules file name. …Correct. The Rules file already has to be created so you can load the data (insert eye rolling, IMHO). You also have to choose between a Dimension Load or Data Load.</p> <p>OH. And you have to type these values in. They are not in a dynamically generated list for you.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image019.png"><img data-attachment-id="2013" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image019-9/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image019.png?w=840&#038;h=403" data-orig-size="1661,797" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image019" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image019.png?w=840&#038;h=403?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image019.png?w=840&#038;h=403?w=840" class="alignnone size-full wp-image-2013" src="https://epmqueen.files.wordpress.com/2018/02/image019.png?w=840&#038;h=403" alt="" width="840" height="403" srcset="https://epmqueen.files.wordpress.com/2018/02/image019.png?w=840&amp;h=403 840w, https://epmqueen.files.wordpress.com/2018/02/image019.png?w=150&amp;h=72 150w, https://epmqueen.files.wordpress.com/2018/02/image019.png?w=300&amp;h=144 300w, https://epmqueen.files.wordpress.com/2018/02/image019.png?w=768&amp;h=369 768w, https://epmqueen.files.wordpress.com/2018/02/image019.png?w=1024&amp;h=491 1024w, https://epmqueen.files.wordpress.com/2018/02/image019.png 1661w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>When you have the items entered, click “Run Job” at the top. Note that it took around 10 times for me to be able to get to a successful job run because of various things not mentioned in the (lean) documentation.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image020.png"><img data-attachment-id="2014" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image020-10/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image020.png?w=840" data-orig-size="455,183" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image020" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image020.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image020.png?w=840?w=455" class="alignnone size-full wp-image-2014" src="https://epmqueen.files.wordpress.com/2018/02/image020.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image020.png 455w, https://epmqueen.files.wordpress.com/2018/02/image020.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image020.png?w=300 300w" sizes="(max-width: 455px) 100vw, 455px" /></a></p> <p>The blue line is the successful run.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image021.png"><img data-attachment-id="2015" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image021-10/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image021.png?w=840&#038;h=195" data-orig-size="1123,261" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image021" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image021.png?w=840&#038;h=195?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image021.png?w=840&#038;h=195?w=840" class="alignnone size-full wp-image-2015" src="https://epmqueen.files.wordpress.com/2018/02/image021.png?w=840&#038;h=195" alt="" width="840" height="195" srcset="https://epmqueen.files.wordpress.com/2018/02/image021.png?w=840&amp;h=195 840w, https://epmqueen.files.wordpress.com/2018/02/image021.png?w=150&amp;h=35 150w, https://epmqueen.files.wordpress.com/2018/02/image021.png?w=300&amp;h=70 300w, https://epmqueen.files.wordpress.com/2018/02/image021.png?w=768&amp;h=178 768w, https://epmqueen.files.wordpress.com/2018/02/image021.png?w=1024&amp;h=238 1024w, https://epmqueen.files.wordpress.com/2018/02/image021.png 1123w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>To note, if you are trying to debug your failed loads, the following file was key for me and helped me navigate my way towards the correct settings.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image022.png"><img data-attachment-id="2016" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image022-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image022.png?w=840" data-orig-size="818,237" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image022" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image022.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image022.png?w=840?w=818" class="alignnone size-full wp-image-2016" src="https://epmqueen.files.wordpress.com/2018/02/image022.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image022.png 818w, https://epmqueen.files.wordpress.com/2018/02/image022.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image022.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image022.png?w=768 768w" sizes="(max-width: 818px) 100vw, 818px" /></a></p> <p>For proof, my one line of data loaded!</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image023.png"><img data-attachment-id="2017" data-permalink="https://realtrigeek.com/2018/02/16/putting-oac-data-sync-2-4-through-the-esscs-paces/image023-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image023.png?w=840" data-orig-size="633,170" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image023" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image023.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image023.png?w=840?w=633" class="alignnone size-full wp-image-2017" src="https://epmqueen.files.wordpress.com/2018/02/image023.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image023.png 633w, https://epmqueen.files.wordpress.com/2018/02/image023.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image023.png?w=300 300w" sizes="(max-width: 633px) 100vw, 633px" /></a></p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1994 Fri Feb 16 2018 14:53:28 GMT-0500 (EST) Announcing Breakout with Blockchain – Emerging Technology at ODTUG Kscope18 https://kscope18.odtug.com/p/bl/et/blogaid=768&source=1 ODTUG is excited to announce new content coming to ODTUG Kscope18! This year, we will be introducing our members to Blockchain and the new Oracle Blockchain Cloud Service. If you're curious about leveraging distributed ledger technology in an enterprise environment, ODTUG Kscope has you covered! ODTUG https://kscope18.odtug.com/p/bl/et/blogaid=768&source=1 Fri Feb 16 2018 14:10:40 GMT-0500 (EST) Announcing Breakout with Blockchain – Emerging Technology at ODTUG Kscope18 https://www.odtug.com/p/bl/et/blogaid=768&source=1 ODTUG is excited to announce new content coming to ODTUG Kscope18! This year, we will be introducing our members to Blockchain and the new Oracle Blockchain Cloud Service. If you're curious about leveraging distributed ledger technology in an enterprise environment, ODTUG Kscope has you covered! ODTUG https://www.odtug.com/p/bl/et/blogaid=768&source=1 Fri Feb 16 2018 14:10:40 GMT-0500 (EST) Oracle and Python setup with cx_Oracle http://www.oralytics.com/2018/02/oracle-and-python-setup-with-cxoracle.html Is Python the new R?<br /><br />Maybe, maybe not, but that I'm finding in recent months is more companies are asking me to use Python instead of R for some of my work.<br /><br />In this blog post I will walk through the steps of setting up the Oracle driver for Python, called <a href="http://www.oracle.com/technetwork/articles/dsl/python-091105.html">cx_Oracle</a>. The <a href="https://oracle.github.io/python-cx_Oracle/">documentation</a> for this drive is good and detailed with plenty of examples available on <a href="https://github.com/oracle/python-cx_Oracle/tree/master/samples">GitHub</a>. Hopefully there isn't anything new in this post, but it is my experiences and what I did.<br /><br /><b><span style="text-decoration: underline;">1. Install Oracle Client</span></b><br />The Python driver requires Oracle Client software to be installed. Go here, download and install. It's a straightforward install. Make sure the directories are added to the search path.<br /><br /><b><span style="text-decoration: underline;">2. Download and install cx_Oracle </span></b><br />You can use pip3 to do this.<br /><pre>&nbsp;</pre><pre>pip3 install cx_Oracle<br /><br />Collecting cx_Oracle<br /> Downloading cx_Oracle-6.1.tar.gz (232kB)<br /> 100% |████████████████████████████████| 235kB 679kB/s<br />Building wheels for collected packages: cx-Oracle<br /> Running setup.py bdist_wheel for cx-Oracle ... done<br /> Stored in directory: /Users/brendan.tierney/Library/Caches/pip/wheels/0d/c4/b5/5a4d976432f3b045c3f019cbf6b5ba202b1cc4a36406c6c453<br />Successfully built cx-Oracle<br />Installing collected packages: cx-Oracle<br />Successfully installed cx-Oracle-6.1 </pre><br /><span style="text-decoration: underline;"><span style="text-decoration: underline;">3. Create a connection in Python</span></span><br />Now we can create a connection. When you see some text enclosed in angled brackets &lt;&gt;, you will need to enter your detailed for your schema and database server.<br /><pre>&nbsp;</pre><pre># import the Oracle Python library<br />import cx_Oracle<br /><br /># define the login details<br />p_username = "<username>"<br />p_password = "<password>"<br />p_host = "<name of="" server-host="">"<br />p_service = "<name db="" of="" service="">"<br />p_port = "1521"<br /><br /># create the connection<br />con = cx_Oracle.connect(user=p_username, password=p_password, dsn=p_host+"/"+p_service+":"+p_port)<br /><br /># an alternative way to create the connection<br /># con = cx_Oracle.connect('<username>/<password>@<host>/<service>:1521')<br /><br /># print some details about the connection and the library<br />print("Database version:", con.version)<br />print("Oracle Python version:", cx_Oracle.version)<br /><br /><br />Database version: 12.1.0.1.0<br />Oracle Python version: 6.1<br /></service></host></password></username></name></name></password></username></pre><br /><span style="text-decoration: underline;"><b>4. Query some data and return results to Python</b></span><br />In this example the query returns the list of tables in the schema.<br /><pre>&nbsp;</pre><pre># define a cursor to use with the connection<br />cur = con.cursor()<br /># execute a query returning the results to the cursor<br />cur.execute('select table_name from user_tables')<br /># for each row returned to the cursor, print the record<br />for row in cur:<br /> print("Table: ", row)<br /><br />Table: ('DECISION_TREE_MODEL_SETTINGS',)<br />Table: ('INSUR_CUST_LTV_SAMPLE',)<br />Table: ('ODMR_CARS_DATA',)<br /></pre><br />Now list the Views available in the schema.<br /><pre>&nbsp;</pre><pre># define a second cursor<br />cur2 = con.cursor()<br /># return the list of Views in the schema to the cursor<br />cur2.execute('select view_name from user_views')<br /># display the list of Views<br />for result_name in cur2:<br /> print("View: ", result_name)<br /><br />View: ('MINING_DATA_APPLY_V',)<br />View: ('MINING_DATA_BUILD_V',)<br />View: ('MINING_DATA_TEST_V',)<br />View: ('MINING_DATA_TEXT_APPLY_V',)<br />View: ('MINING_DATA_TEXT_BUILD_V',)<br />View: ('MINING_DATA_TEXT_TEST_V',)<br /></pre><br /><b><span style="text-decoration: underline;">5. Query some data and return to a Panda in Python</span></b><br />Pandas are commonly used for storing, structuring and processing data in Python, using a data frame format. The following returns the results from a query and stores the results in a panda. <br /><pre>&nbsp;</pre><pre># in this example the results of a query are loaded into a Panda<br /># load the pandas library<br />import pandas as pd<br /><br /># execute the query and return results into the panda called df<br />df = pd.read_sql_query("SELECT * from INSUR_CUST_LTV_SAMPLE", con)<br /><br /># print the records returned by query and stored in panda<br />print(df.head())<br /><br /> CUSTOMER_ID LAST FIRST STATE REGION SEX PROFESSION \<br />0 CU13388 LEIF ARNOLD MI Midwest M PROF-2 <br />1 CU13386 ALVA VERNON OK Midwest M PROF-18 <br />2 CU6607 HECTOR SUMMERS MI Midwest M Veterinarian <br />3 CU7331 PATRICK GARRETT CA West M PROF-46 <br />4 CU2624 CAITLYN LOVE NY NorthEast F Clerical <br /><br /> BUY_INSURANCE AGE HAS_CHILDREN ... MONTHLY_CHECKS_WRITTEN \<br />0 No 70 0 ... 0 <br />1 No 24 0 ... 9 <br />2 No 30 1 ... 2 <br />3 No 43 0 ... 4 <br />4 No 27 1 ... 4 <br /><br /> MORTGAGE_AMOUNT N_TRANS_ATM N_MORTGAGES N_TRANS_TELLER \<br />0 0 3 0 0 <br />1 3000 4 1 1 <br />2 980 4 1 3 <br />3 0 2 0 1 <br />4 5000 4 1 2 <br /><br /> CREDIT_CARD_LIMITS N_TRANS_KIOSK N_TRANS_WEB_BANK LTV LTV_BIN <br />0 2500 1 0 17621.00 MEDIUM <br />1 2500 1 450 22183.00 HIGH <br />2 500 1 250 18805.25 MEDIUM <br />3 800 1 0 22574.75 HIGH <br />4 3000 2 1500 17217.25 MEDIUM <br /><br />[5 rows x 31 columns]<br /></pre><br /><b><span style="text-decoration: underline;">6. Wrapping it up and closing things</span></b><br />Finally we need to wrap thing up and close our cursors and our connection to the database. <br /><pre>&nbsp;</pre><pre># close the cursors<br />cur2.close()<br />cur.close()<br /><br /># close the connection to the database<br />con.close()<br /></pre><br /><span style="text-decoration: underline;">Useful links</span><br /><a href="http://www.oracle.com/technetwork/articles/dsl/python-091105.htm">cx_Oracle website</a><br /><a href="https://oracle.github.io/python-cx_Oracle/">cx_Oracle documentation</a><br /><a href="https://github.com/oracle/python-cx_Oracle/tree/master/samples">cx_Oracle examples on GitHub</a><br /><br />Watch out for more blog posts on using Python with Oracle, Oracle Data Mining and Oracle R Enterprise. Brendan Tierney tag:blogger.com,1999:blog-4669933501315263808.post-86902960669894300 Tue Feb 13 2018 07:06:00 GMT-0500 (EST) Confluent Partnership http://www.rittmanmead.com/blog/2018/02/confluent-partnership/ <p><img src="http://www.rittmanmead.com/blog/content/images/2018/02/Confluent-color-block-logo.png" alt="Confluent"></p> <p>Here at Rittman Mead, we are continually broadening the scope and expertise of our services to help our customers keep pace with today's ever-changing technology landscape. One significant change we have seen over the last few years is the increased adoption of data streaming. These solutions can help solve a variety of problems, from real-time data analytics to forming the entire backbone of an organisation's data architecture. We have worked with a number of different technologies that can enable this, however, we often see that <a href="https://kafka.apache.org">Kafka</a> ticks the most boxes.</p> <p>This is reflected by some of the recent blog posts you will have seen like Tom Underhill hooking up his <a href="https://www.rittmanmead.com/blog/2017/11/taking-ksql-for-a-spin-using-real-time-device-data/">gaming console to Kafka</a> and Paul Shilling’s piece on <a href="https://www.rittmanmead.com/blog/2018/01/real-time-yacht-performance/">collating sailing data</a>. Both these posts try and use day to day or real-world examples to demonstrate some of the concepts behind Kafka.</p> <p>In conjunction with these, we have been involved in more serious proofs of concepts and project with clients involving Kafka, which no doubt we will write about in time. To help us further our knowledge and also immerse ourselves in the developer community we have decided to become <a href="https://www.confluent.io">Confluent</a> partners. <a href="https://www.confluent.io">Confluent</a> was founded by the people who initially developed Kafka at LinkedIn and provides a managed and supported version of Kafka through their platform.</p> <p>We chose <a href="https://www.confluent.io">Confluent</a> as we saw them as the driving force behind Kafka, plus the additions they are making to the platform such as the streaming API and <a href="https://www.confluent.io/product/ksql/">KSQL</a> are opening a lot of doors for how streamed data can be used.</p> <p>We look forward to growing our knowledge and experience in this area and the possibilities that working with both Kafka and Confluent will bring us.</p> Jon Mead 030cdf81-49b6-49a8-84a4-0d716e338e40 Mon Feb 12 2018 10:14:05 GMT-0500 (EST) How to Enable Commentary in OBIEE https://www.us-analytics.com/hyperionblog/how-to-enable-commentary-in-obiee <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/how-to-enable-commentary-in-obiee" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/Enable%20Commentary%20in%20OBIEE_landing%20page%20image.png?t=1518192988218" alt="Enable Commentary in OBIEE_landing page image" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span>We hear it all the time: "I want commentary in OBIEE." The current method of sending screenshots with comments via email wreaks havoc on your workflow and data consistency.&nbsp;</span></p> <p><span>But now, there's CollaborateBI, an unobtrusive tool that allows you to easily add commentary directly in OBIEE. <strong><a href="https://www.us-analytics.com/enable-commentary-in-obiee">Download the white paper</a></strong> to find out everything you can do with this tool, including...</span></p> <ul> <li> <p><span>Adding commentary on dashboards and reports</span></p> </li> <li> <p><span style="background-color: transparent;">Shortening your workflow with the ability to attach critical documentation to your dashboard</span></p> </li> <li> <p><span>Simplifying your workflow by integrating with your organization's email service and instant messenging tool.</span></p> </li> </ul> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fhow-to-enable-commentary-in-obiee&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Nicholas Padgett https://www.us-analytics.com/hyperionblog/how-to-enable-commentary-in-obiee Fri Feb 09 2018 13:37:24 GMT-0500 (EST) ODTUG February News https://www.odtug.com/p/bl/et/blogaid=767&source=1 The ODTUG February News features the WIT Scholar Application, ODTUG Kscope18 updates, ODTUG community news, upcoming Meetups, upcoming ODTUG webinars, Oracle Cloud Customer Connect webinars and information, and more! ODTUG https://www.odtug.com/p/bl/et/blogaid=767&source=1 Wed Feb 07 2018 10:49:05 GMT-0500 (EST) Women in Technology Scholar - Now Accepting Applications https://www.odtug.com/p/bl/et/blogaid=766&source=1 ODTUG is pleased to announce the fourth annual ODTUG Women in Technology Scholarship program. The scholarship recipient will be awarded a complimentary pass to ODTUG Kscope18. ODTUG https://www.odtug.com/p/bl/et/blogaid=766&source=1 Wed Feb 07 2018 10:37:29 GMT-0500 (EST) Women in Technology Scholar - Now Accepting Applications https://kscope18.odtug.com/p/bl/et/blogaid=766&source=1 ODTUG is pleased to announce the fourth annual ODTUG Women in Technology Scholarship program. The scholarship recipient will be awarded a complimentary pass to ODTUG Kscope18. ODTUG https://kscope18.odtug.com/p/bl/et/blogaid=766&source=1 Wed Feb 07 2018 10:37:29 GMT-0500 (EST) PBCS and EPBCS Updates (February 2018): New Rules Usage Report, Expanded Simplified Audit, Removal of Support & More https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2018-february-updates <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2018-february-updates" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/Fotolia_130347409_Subscription_Monthly_M.jpg?t=1519157959954" alt="Fotolia_130347409_Subscription_Monthly_M" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The February updates for Oracle's<span>&nbsp;</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">Planning &amp; Budgeting Cloud Service (PBCS) and Enterprise Planning and Budgeting Cloud Service (EPBCS)</a><span>&nbsp;are here.&nbsp;</span>This blog post outlines several new features for both applications.</p> <p><em>The monthly update for PBCS and EPBCS will occur on Friday, February 16 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fpbcs-and-epbcs-2018-february-updates&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2018-february-updates Tue Feb 06 2018 15:03:38 GMT-0500 (EST) The Science Behind Oracle Data Visualization: Clusters https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/ <p>This is the second post in a series about the science behind Oracle’s Data Visualization. This post continues the dive into the Advanced Analytics tab. As a reminder, the AA tab is located here:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image001.png"><img data-attachment-id="1974" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image001-14/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image001.png?w=840" data-orig-size="255,336" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image001" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image001.png?w=840?w=228" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image001.png?w=840?w=255" class="alignnone size-full wp-image-1974" src="https://epmqueen.files.wordpress.com/2018/02/image001.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image001.png 255w, https://epmqueen.files.wordpress.com/2018/02/image001.png?w=114 114w" sizes="(max-width: 255px) 100vw, 255px" /></a></p> <p>I’m going to continue using my Boston Marathon finish times as the sample data set. Recall that some people have won the BM more than once so to distinguish between each of their finish times, I have added a column called “Name Unique” to treat each finish separately.</p> <p>The first thing I want to show are the options for Clusters in DV. In my Scatter (Category) diagram I have a simple visualization of each finish time by name. I’m going to add Clusters to Color.</p> <p>Original:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image002.png"><img data-attachment-id="1975" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image002-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image002.png?w=840" data-orig-size="1770,856" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image002" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image002.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image002.png?w=840?w=840" class="alignnone size-full wp-image-1975" src="https://epmqueen.files.wordpress.com/2018/02/image002.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image002.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image002.png?w=1680 1680w, https://epmqueen.files.wordpress.com/2018/02/image002.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image002.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image002.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image002.png?w=1024 1024w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Clusters:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image003.png"><img data-attachment-id="1976" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image003-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image003.png?w=840" data-orig-size="1765,858" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image003" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image003.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image003.png?w=840?w=840" class="alignnone size-full wp-image-1976" src="https://epmqueen.files.wordpress.com/2018/02/image003.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image003.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image003.png?w=1680 1680w, https://epmqueen.files.wordpress.com/2018/02/image003.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image003.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image003.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image003.png?w=1024 1024w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>In the lower right-hand corner, we see the details behind our Clusters when we click the AA tab:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image004.png"><img data-attachment-id="1977" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image004-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image004.png?w=840" data-orig-size="252,289" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image004" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image004.png?w=840?w=252" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image004.png?w=840?w=252" class="alignnone size-full wp-image-1977" src="https://epmqueen.files.wordpress.com/2018/02/image004.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image004.png 252w, https://epmqueen.files.wordpress.com/2018/02/image004.png?w=131 131w" sizes="(max-width: 252px) 100vw, 252px" /></a></p> <p>By default, we get 5 clusters using K-Means with each data point being evaluated individually. The other option we have for Algorithm is Hierarchical. We can choose as many groups as we would like (although 1 would not make sense because then we are back to our original visualization). We can also choose between Cell, Rows, Columns, or Rows &amp; Columns for our Trellis Scope. Let’s start with the math behind K-Means versus Hierarchical.</p> <p>K-Means</p> <p>Before we address the math, I think you will be surprised to learn there is less defined math in Clustering than you might think. It’s more an art with some science thrown in the mix. And it’s truly a process versus a formula. The process is as follows:</p> <ol start="1"> <li>Choose the number of clusters you would like in your data.</li> <li>Make as best a guesstimate as to the centroid (center) of each cluster. These do not have to be actual values in your data.</li> <li>Take the standard Euclidean distance from each data point to its centroid.</li> <li>Recalculate the centroids by taking the sum of all the means of all the data points assigned to a centroid’s cluster.</li> <li>Keep doing 2-4 until a stopping criteria is reached: <ol start="1"> <li>No data points change clusters.</li> <li>The sum of the distances is minimized.</li> <li>A prearranged number of iterations is reached.</li> </ol> </li> </ol> <p>Not quite as scientific as you thought, huh? Part of the reason is because clustering is used as a data exploratory tool and has no general theoretical solution for the optimal number of clusters given a data set. The theory behind K-Means is an optimization algorithm and the solution will be optimal to the initial configuration. If the initial configuration changes, then there could be a better optimal solution. Note that K-Means is susceptible to Outliers. I added Outliers to my visualization as a shape to show the options…similar to Clusters. Notice that the Outliers occur in the top and bottom cluster strata. We will visit Outliers later, but I wanted to show the relationship.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image005.png"><img data-attachment-id="1978" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image005-14/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image005.png?w=840" data-orig-size="1574,602" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image005" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image005.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image005.png?w=840?w=840" class="alignnone size-full wp-image-1978" src="https://epmqueen.files.wordpress.com/2018/02/image005.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image005.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image005.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image005.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image005.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image005.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image005.png 1574w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Hierarchical</p> <p>This one is MUCH different than K-Means and involves no math. In fact, it is – more or less – eyeballing close relatives in a set of individual data points. If we take a look at the diagram below, it kind of looks like a NCAA March Madness bracket. And, actually, that is essentially what the basketball brackets are – hierarchical clustering. Back to the diagram… So what is the process to go from the individual data points to the end result, one cluster?</p> <ol start="1"> <li>Each individual data point is its own cluster. This would be the far right of the diagram.</li> <li>Look at the data points and group together ones that are close.</li> <li>Keep merging similar pairs until you have one cluster.</li> </ol> <p>See, there is no real function to use as a base here, unlike with K-Means. If you want k number of groups, then just remove the k-1 longest links.</p> <p><img data-attachment-id="1979" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image006-13/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image006.png?w=840" data-orig-size="" data-comments-opened="1" data-image-meta="[]" data-image-title="image006" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image006.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image006.png?w=840?w=840" class="alignnone size-full wp-image-1979" src="https://epmqueen.files.wordpress.com/2018/02/image006.png?w=840" alt="" /></p> <p>(Thank you to the <a href="https://commons.wikimedia.org/w/index.php?curid=47743417"> link</a> for the visualization!)</p> <p>Let’s change our visualization to be Hierarchical and keep K-Means at the top for reference.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image007.png"><img data-attachment-id="1980" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image007-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image007.png?w=840" data-orig-size="1595,845" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image007" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image007.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image007.png?w=840?w=840" class="alignnone size-full wp-image-1980" src="https://epmqueen.files.wordpress.com/2018/02/image007.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image007.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image007.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image007.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image007.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image007.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image007.png 1595w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>We see that there is considerably fewer points in clusters 3-5. In the Hierarchical visualization there appears to be a hierarchy, going from bottom to top. So which one to use? Depends on your goals and data. If you are looking for data that might be Outlier-ish, then K-Means may work better. If you are looking for stratifications in your data, then Hierarchical might work better. …But you know your data better than I do!</p> <p>To finish off the options, you can choose how to cluster the data based on the cell value, rows, columns, or both. The default is Cell and the data points are evaluated individually. With Rows, the values are evaluated on a row basis (ie: Nationality). With Columns, the values are evaluated by the chosen Column(s) (ie: Gender). If you choose Rows &amp; Columns, then it is a function of those items. Because our data set is not ideal for showing these options, it might help to see a visual of what I just described:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image008.png"><img data-attachment-id="1981" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image008-14/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image008.png?w=840" data-orig-size="1340,648" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image008" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image008.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image008.png?w=840?w=840" class="alignnone size-full wp-image-1981" src="https://epmqueen.files.wordpress.com/2018/02/image008.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image008.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image008.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image008.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image008.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image008.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image008.png 1340w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Going back to our Scatter visualization, here is Cell for base visualization:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image009.png"><img data-attachment-id="1982" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image009-14/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image009.png?w=840" data-orig-size="1595,848" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image009" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image009.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image009.png?w=840?w=840" class="alignnone size-full wp-image-1982" src="https://epmqueen.files.wordpress.com/2018/02/image009.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image009.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image009.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image009.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image009.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image009.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image009.png 1595w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>If we change this to Rows, we don’t get a change.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image010.png"><img data-attachment-id="1983" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image010-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image010.png?w=840" data-orig-size="1598,846" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image010" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image010.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image010.png?w=840?w=840" class="alignnone size-full wp-image-1983" src="https://epmqueen.files.wordpress.com/2018/02/image010.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image010.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image010.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image010.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image010.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image010.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image010.png 1598w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>However, if we change to Columns, we see the Men’s row change quite a bit.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image011.png"><img data-attachment-id="1984" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image011-13/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image011.png?w=840" data-orig-size="1593,847" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image011" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image011.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image011.png?w=840?w=840" class="alignnone size-full wp-image-1984" src="https://epmqueen.files.wordpress.com/2018/02/image011.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image011.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image011.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image011.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image011.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image011.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image011.png 1593w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>When we choose Rows &amp; Columns, the visualization doesn’t change since only Columns produced a change in clustering.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/02/image012.png"><img data-attachment-id="1985" data-permalink="https://realtrigeek.com/2018/02/06/the-science-behind-oracle-data-visualization-clusters/image012-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/02/image012.png?w=840" data-orig-size="1598,849" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image012" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/02/image012.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/02/image012.png?w=840?w=840" class="alignnone size-full wp-image-1985" src="https://epmqueen.files.wordpress.com/2018/02/image012.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/02/image012.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/02/image012.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/02/image012.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/02/image012.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/02/image012.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/02/image012.png 1598w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Hopefully you feel a bit more educated on clustering. Too bad it’s more an art than a science!</p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1973 Tue Feb 06 2018 12:50:27 GMT-0500 (EST) FCCS Updates (February 2018): Support for Auto-Reversing Journals, Enabling Balance Calculation, Considerations & More https://www.us-analytics.com/hyperionblog/fccs-updates-february-2018 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/fccs-updates-february-2018" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/Fotolia_187303978_Subscription_Monthly_M.jpg?t=1519157959954" alt="Fotolia_187303978_Subscription_Monthly_M" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The latest updates for&nbsp;<a href="https://www.us-analytics.com/hyperionblog/faq-oracle-financial-consolidation-and-close-cloud-service-fccs">Oracle's<span>&nbsp;Financial Consolidation and Close Cloud Service</span>&nbsp;(FCCS)</a><span> are here</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">.</a><span>&nbsp;</span>This blog post outlines multiple new features, fixed defects, and considerations.</p> <p><em>The monthly update for FCCS will occur on Friday, February 16 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ffccs-updates-february-2018&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/fccs-updates-february-2018 Tue Feb 06 2018 12:43:25 GMT-0500 (EST) EPRCS Updates (February 2018): Drill to Content, Saved Member Selections in Management Reports, Considerations & More https://www.us-analytics.com/hyperionblog/eprcs-updates-february-2018 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/eprcs-updates-february-2018" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/epbrcs%20february%202018%20update.jpg?t=1519157959954" alt="epbrcs february 2018 update" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>In this blog, we'll cover the February updates for&nbsp;<a href="https://www.us-analytics.com/hyperionblog/enterprise-performance-reporting-cloud">Oracle Enterprise Performance Reporting Cloud Service (EPRCS)</a>&nbsp;including new features and considerations.&nbsp;</p> <p><em>The monthly update for EPRCS will occur on Friday, February 16 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Feprcs-updates-february-2018&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/eprcs-updates-february-2018 Tue Feb 06 2018 11:38:47 GMT-0500 (EST) ARCS Updates (February 2018): Deleting Transactions, Archive, Purge, Restore Reconciliations, and More https://www.us-analytics.com/hyperionblog/arcs-product-update-february-2018 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/arcs-product-update-february-2018" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/arcs%20february%202018%20update.jpg?t=1519157959954" alt="arcs february 2018 update" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The February updates for Oracle's&nbsp;<a href="https://www.us-analytics.com/hyperionblog/faq-account-reconciliation-cloud-service-arcs">Account Reconciliation Cloud Service (ARCS</a>) have arrived. In this blog post, we’ll outline new features in reconciliation compliance, transaction matching, fixed defects, and more.</p> <p>We’ll let you know any time there are updates to ARCS or any other Oracle EPM cloud products. Check the&nbsp;<a href="https://www.us-analytics.com/hyperionblog">US-Analytics Oracle EPM &amp; BI Blog</a><span>&nbsp;</span>every month.</p> <p><em>The monthly update for Oracle ARCS will occur on Friday, February 16 during your normal daily maintenance window.</em></p> <h3 style="text-align: center;"></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Farcs-product-update-february-2018&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/arcs-product-update-february-2018 Tue Feb 06 2018 11:03:54 GMT-0500 (EST) February Webinars https://www.odtug.com/p/bl/et/blogaid=765&source=1 Is there a topic you would like covered but do not see here? We are happy to take webinar suggestions. Email us at kgately@odtug.com. Did you miss a webinar? As an ODTUG member you can view all of our past webinars at any time. ODTUG https://www.odtug.com/p/bl/et/blogaid=765&source=1 Mon Feb 05 2018 17:08:23 GMT-0500 (EST) Special Event Announcement https://www.odtug.com/p/bl/et/blogaid=764&source=1 On Wednesday, June 13, 2018, join us for the ODTUG Kscope18 Special Event at Andretti Indoor Karting & Games in Orlando, Florida! ODTUG https://www.odtug.com/p/bl/et/blogaid=764&source=1 Mon Feb 05 2018 17:04:50 GMT-0500 (EST) Special Event Announcement https://kscope18.odtug.com/p/bl/et/blogaid=764&source=1 On Wednesday, June 13, 2018, join us for the ODTUG Kscope18 Special Event at Andretti Indoor Karting & Games in Orlando, Florida! ODTUG https://kscope18.odtug.com/p/bl/et/blogaid=764&source=1 Mon Feb 05 2018 17:04:50 GMT-0500 (EST) ODTUG Kscope18 5K Fun Run Announcement https://www.odtug.com/p/bl/et/blogaid=763&source=1 Happy New Year! Stay true to your New Year's fitness resolution and have more FUN at ODTUG Kscope18 this year by participating in the 5K Fun Run! ODTUG https://www.odtug.com/p/bl/et/blogaid=763&source=1 Mon Feb 05 2018 17:00:35 GMT-0500 (EST) ODTUG Kscope18 5K Fun Run Announcement https://kscope18.odtug.com/p/bl/et/blogaid=763&source=1 Happy New Year! Stay true to your New Year's fitness resolution and have more FUN at ODTUG Kscope18 this year by participating in the 5K Fun Run! ODTUG https://kscope18.odtug.com/p/bl/et/blogaid=763&source=1 Mon Feb 05 2018 17:00:35 GMT-0500 (EST) ODTUG January News https://www.odtug.com/p/bl/et/blogaid=762&source=1 ODTUG's January news includes the announcement of the 2018 - 2019 Executive Committee, ODTUG Kscope18 updates, Oracle Cloud Connect upcoming webinars, ODTUG's community news, and upcoming ODTUG webinars. ODTUG https://www.odtug.com/p/bl/et/blogaid=762&source=1 Mon Feb 05 2018 16:55:23 GMT-0500 (EST) Essbase: The Cloud vs. On-Prem https://www.us-analytics.com/hyperionblog/essbase-the-cloud-vs-on-prem <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/essbase-the-cloud-vs-on-prem" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/social-suggested-images/the%20cloud%20vs%20on-prem%20webinar%20header_skinny_smaller%20text-2.png?t=1519157959954" alt="the cloud vs on-prem webinar header_skinny_smaller text-2" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>Finance and budgeting teams have long been fans of Essbase — being able to store aggregated values gives users the flexibility to efficiently report and run scenarios. So, when we talk about Essbase, Hyperion Planning is often part of the conversation, too.</p> <p>But, is <strong><a href="https://www.us-analytics.com/hyperionblog/faq-oracle-essbase-cloud">Essbase in the cloud</a></strong> going to change the way we talk about and consider Essbase? In this blog post, we’ll look at some of the major differences between on-prem and cloud-based Essbase, and how having this tool in the cloud can help your organization in ways you may not have considered yet.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fessbase-the-cloud-vs-on-prem&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/essbase-the-cloud-vs-on-prem Fri Feb 02 2018 10:53:52 GMT-0500 (EST) The Science Behind Oracle Data Visualization: Trend https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/ <p>This is the start of a new series that I’m excited about diving into. Back in college one of my degrees included a concentration in Quantitative Analysis. I loved statistics since my first exposure to it in high school and found that I did pretty well at the subject. Statistics has always come naturally for me but found it hard to get a job in the area without at least a Masters degree. I started getting excited about 2-3 years ago when statistics, namely advanced analytics, started becoming a staple in many IT and functional organizations. Data visualization is part of this staple and it’s not just…data art. It’s very much a science that plays well to the artists inside us.</p> <p>When I teach people Data Visualization, I find they try to jump into visualizations too fast without understanding why or how they work. They want to see pictures, quickly and making their data make sense on the first try. …I hate to break it to you, but it almost never works like that. While the incoming college hires are more data savvy than the ‘old guard’, there is still a fundamental education that needs to occur about the different types of data out there. While this post (and series, at least initially) will not be diving into the different data types, it is important to understand the difference between facts/measures, attributes, dates, and spatial data.</p> <p>This series’ focus is on explaining the options you have available to you in Oracle Data Visualization. You have <em>considerably</em> more statistical power available to you than you might imagine!</p> <p>The first stop on the analysis train is Trend. You may think you already understand this concept since we throw the word around as common language – “The stock market trend is going up”, for example. But within DV, you have different Trend options available to you whether it be the Method (Linear, Exponential, or Polynomial), the Degree, or the Confidence Interval (90%, 95%, 99%, off).</p> <p>Trend can be found on the Advanced Analytics tab to be added to a visualization containing a date (as shown by right-clicking on “Trend” to add it to my visualization.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0011.png"><img data-attachment-id="1958" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0011-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0011.png?w=840" data-orig-size="236,220" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0011" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0011.png?w=840?w=236" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0011.png?w=840?w=236" class="alignnone size-full wp-image-1958" src="https://epmqueen.files.wordpress.com/2018/01/image0011.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0011.png 236w, https://epmqueen.files.wordpress.com/2018/01/image0011.png?w=150 150w" sizes="(max-width: 236px) 100vw, 236px" /></a></p> <p>My data is set is the time of the male winners of the Boston Marathon since 1900 (I’ll add women later, but because of sexism, they were not added until the late 1960s) in minutes. When I plot the data with Trend added, I get the following result:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0021.png"><img data-attachment-id="1959" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0021-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=840" data-orig-size="1432,734" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0021" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=840?w=840" class="alignnone size-full wp-image-1959" src="https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/image0021.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/image0021.png 1432w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>The arrow shows the automatic trend line that was added to my visualization. I have put a box around the details behind my trend line. By default, the trend line is a Linear line with a 95% confidence interval. But what are the other options? If you open the Method drop down list, you will see options for Linear, Exponential, and Polynomial. But what do each of these mean? Let’s take a look…</p> <p>Let’s start with our default, the Linear trend line. Not to go into the math behind the line, but (yep, I’m going there) the formula is one that you will recognize from junior high:</p> <p>Y(t) = a + bt</p> <p>Or, more commonly,</p> <p>y = mx + b</p> <p>y = ȳ &#8211; slope * x̄</p> <p>where:</p> <p>a = b = intercept</p> <p>b = m = ( S((x &#8211; x̄)/(y <strong>&#8211;</strong> ȳ))) / (x -x̄)2</p> <p>y = dependent variable (time is required for y to have a value)</p> <p>t = time; independent variable (will occur with or without y)</p> <p>So, why is (any of) this important?</p> <p>A linear trend creates a line. While somewhat helpful when the data points seem to follow a straight line, it’s not often appropriate for most types of data. This is especially true if, especially towards the end of the line, the actual data points are not even in the Confidence Interval band (wait for it…). If it is true that the end of the data points are not in the CI band, then how can you accurately forecast?? This brings me to the 2 other types of trend methods available…</p> <p>The next on the list is Exponential:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0031.png"><img data-attachment-id="1960" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0031-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0031.png?w=840" data-orig-size="207,194" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0031" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0031.png?w=840?w=207" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0031.png?w=840?w=207" class="alignnone size-full wp-image-1960" src="https://epmqueen.files.wordpress.com/2018/01/image0031.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0031.png 207w, https://epmqueen.files.wordpress.com/2018/01/image0031.png?w=150 150w" sizes="(max-width: 207px) 100vw, 207px" /></a></p> <p>The Exponential method is especially useful if you see sharp growth or decay in your numbers (but cannot be used if there are zero or null data points in your set!). If I change to this method, you will see that my trend line is starting to get a curve:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0041.png"><img data-attachment-id="1961" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0041-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=840" data-orig-size="1434,734" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0041" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=840?w=840" class="alignnone size-full wp-image-1961" src="https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/image0041.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/image0041.png 1434w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Again, we are at our default 95% CI. Because we have no sharp incline or decline in our data, we won’t see the real value of this method.</p> <p>The formula for Exponential Trend is:</p> <p>Y = Arx</p> <p>Where:</p> <p>r = 10m where m is the same formula as in Linear for slope</p> <p>A = 10b where b is the same formula as in Linear for intercept</p> <p>In our example, if we take the first 10 years and math it all out in Excel, here are the results:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0051.png"><img data-attachment-id="1962" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0051-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=840" data-orig-size="797,205" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0051" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=840?w=797" class="alignnone size-full wp-image-1962" src="https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0051.png 797w, https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0051.png?w=768 768w" sizes="(max-width: 797px) 100vw, 797px" /></a></p> <p>The bottom line is the regression. If we filter for only the first 10 years, we can see our trend line change because there was some volatility in 1909 (which from research I found that it was 100*…YES, ONE HUNDRED DEGREES…on the day of the race!).</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0061.png"><img data-attachment-id="1963" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0061-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=840" data-orig-size="1434,716" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0061" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=840?w=840" class="alignnone size-full wp-image-1963" src="https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/image0061.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/image0061.png 1434w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>Let’s move onto the Polynomial trend line… When I add this Method to my graph, I get a more true trend over time. We also get a new option: Degree. We will get to that…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0071.png"><img data-attachment-id="1964" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0071-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=840" data-orig-size="1434,733" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0071" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=840?w=840" class="alignnone size-full wp-image-1964" src="https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/image0071.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/image0071.png 1434w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>We can see that more data points fall in the 95% CI band. This is because this method allows for more data fluctuations over a large data set. For financial data, this would be my recommendation. Actually, in general, I opt for a Polynomial trend.</p> <p>The formula is more complicated…</p> <p>Yi = b0 + b1ti + … + bptip + ei</p> <p>Sigh. I could go into more details, but suffice it say that the formula is an extrapolation of the Linear trend to account for variations in all the data points around a 3 dimensional axis (vectors for those who have had Linear Algebra). In fact, if you have had Linear Algebra (sneaked by, myself) you might notice you can create matrices to do the math by using the formula:</p> <p>bhat= (X’X)-1 X’y</p> <p>Where b hat = (transpose of the matrix times the original matrix) to the matrix inverse times the transposed matrix times y. Yeah, I’ll spare you.</p> <p>This is where the Degree gets important…it determines how many iterations of the above formula you will do and to what degree (aha!). A first degree polynomial is called a straight line, or linear regression. A second degree polynomial is call a quadratic regression (or exponential for our purposes). The next degree, 3rd &#8230;which is why the Degree option starts at 3… is called a cubic polynomial. The 4th, quartic and so on.</p> <p>But why would you want to change the Degree? It depends on how many “valleys and peaks” you want in your trend line. You will have n-1 valleys and peaks for the Degree you choose. Since it defaulted to 3, I have 2:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0081.png"><img data-attachment-id="1965" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0081-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=840" data-orig-size="1434,733" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0081" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=840?w=840" class="alignnone size-full wp-image-1965" src="https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/image0081.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/image0081.png 1434w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>If you have a full year of data, you may want to choose a Degree of 4 to show how each season is represented in your graph. See, it is all making sense! If you’ll permit me to get a bit nuts, I’m going to change the Degree to 7. I will expect 6 valleys and peaks in my data:</p> <p>Although subtle at the end because the times have, more or less, normalized, I can still pick out my 6 waves:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0091.png"><img data-attachment-id="1966" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0091-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=840" data-orig-size="1436,733" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0091" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=840?w=840" class="alignnone size-full wp-image-1966" src="https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/image0091.png?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/image0091.png 1436w" sizes="(max-width: 840px) 100vw, 840px" /></a></p> <p>You’ll never going to settle for the default Trend options again, are you?</p> <p>Let’s go back to Confidence Intervals… A CI is the probability that a given recorded value will fall within a certain range. The calculation is pretty simple:</p> <p>CI = x̄ ± z (s / Ön)</p> <p>If we want to choose the CI for the first 10 years of the Boston Marathon finish times, we will get</p> <p>n = sample = 10 years</p> <p>x̄ = mean = 158.316 minutes</p> <p>s = standard deviation = 9.2311</p> <p>z-score for 95% = table lookup = 1.96</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image0101.png"><img data-attachment-id="1967" data-permalink="https://realtrigeek.com/2018/01/31/the-science-behind-oracle-data-visualization-trend/image0101-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image0101.png?w=840" data-orig-size="156,119" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image0101" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image0101.png?w=840?w=156" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image0101.png?w=840?w=156" class="alignnone size-full wp-image-1967" src="https://epmqueen.files.wordpress.com/2018/01/image0101.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image0101.png 156w, https://epmqueen.files.wordpress.com/2018/01/image0101.png?w=150 150w" sizes="(max-width: 156px) 100vw, 156px" /></a></p> <p>CI = 158.316 ± 1.96 (9.2311 / Ö10)</p> <p>CI = 158.316 ± 5.7215</p> <p>There’s our CI for the first 10 years – 95% sure that the numbers will fall between 152.5945 and 164.0375. You might also recognize this as the margin of error you keep hearing about…</p> <p>If you want to increase the CI, you will notice the band get larger. You can also turn it off to focus on the trend and not trend and CI.</p> <p>Hopefully you have a better appreciation for what the Trend Methods and Degrees can do for you. Do NOT just stick with the Trend defaults! You are missing out on key data analysis results!</p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1957 Wed Jan 31 2018 20:44:32 GMT-0500 (EST) 4 Factors Affecting Your OBIEE Performance https://www.us-analytics.com/hyperionblog/factor-affecting-obiee-performance <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/factor-affecting-obiee-performance" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/factors%20affecting%20obiee%20performance.jpg?t=1519157959954" alt="factors affecting obiee performance" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>Poor performance tends to come up a lot when people talk about OBIEE. It’s a definite source of frustration, especially when finding the root cause of performance issues is no simple task. But things can get better — you just have to know where to start.</p> <p>This blog post can act as a starting point to solving your performance issues. In it, we’ll tell you about several factors that might be affecting your OBIEE performance and we’ll even offer you several solutions.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ffactor-affecting-obiee-performance&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Nicholas Padgett https://www.us-analytics.com/hyperionblog/factor-affecting-obiee-performance Tue Jan 30 2018 16:15:17 GMT-0500 (EST) 5 Tips and Tricks for OBIEE Power Users https://www.us-analytics.com/hyperionblog/tips-for-obiee-power-users <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/tips-for-obiee-power-users" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/tutorials%20for%20obiee%20power%20users.jpg?t=1519157959954" alt="tutorials for obiee power users" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>Needless to say, you won’t become an OBIEE power user overnight. If you’re new to the tool, you have a lot to learn. If you’ve been using the tool for a few years, you still have a lot to learn. With OBIEE, the learning never stops.</p> <p>The great news is there are a lot of cool tricks out there that can help you become a better OBIEE user. In this blog post, we’ll cover 5 tips and tricks — and then show you where you can find even more.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ftips-for-obiee-power-users&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/tips-for-obiee-power-users Thu Jan 25 2018 15:18:28 GMT-0500 (EST) All about Meetups! https://devepm.com/2018/01/23/all-about-meetups/ Hey guys how are you doing? It has been a long long LONG time since our last post&#8230;. and we are sorry for that. We having been very busy with a lot of projects (both work and personal) and we had to get some time for us! But we are finally getting back to action! [&#8230;] RZGiampaoli http://devepm.com/?p=1703 Tue Jan 23 2018 13:33:40 GMT-0500 (EST) What’s the Big Deal with Big Data? https://blog.redpillanalytics.com/whats-the-big-deal-with-big-data-efae9f0ce06a?source=rss----abcc62a8d63e---4 <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BCCpCvuTVSrZGagb2hQGJA.jpeg" /><figcaption>Photo credit: <a href="http://herowallpaper.com/">http://herowallpaper.com/</a></figcaption></figure><h4>What HBR’s Winter 2017 OnPoint Tells Us About Business &amp; Data</h4><p>It was a November evening that I was at the grocery store, waiting in the line to check out when I saw the latest issue of Harvard Business Review’s <em>OnPoint</em> publication. For those that are unaware, <em>OnPoint</em> is a seasonal publication that focuses on a particular topic. I typically pass these by, but this time I shelled out nearly $20 for the magazine as this volume was called <em>The Data Driven Manager</em>.</p><p>I bought this for a few reasons. As a data professional I think it’s important to stay up to date as to what is happening in our field. I also think it is a great idea to read articles like the ones found in publications like HBR and MIT Sloane Management Review because they can offer different perspectives on problems; and sometimes those perspectives can challenge what we believe or have seen. However, I mostly bought this copy of <em>OnPoint</em> because I was curious as to what is being talked about at large in academia. And by extension, what other people think is important in the world of data.</p><h3>So, what did I learn?</h3><h4>This isn’t new news…</h4><p>The first article (in both publication date and appearance in the OnPoint) was titled <em>Competing on Analytics</em> by Thomas H. Davenport (Mr. Davenport later went on to write a book with the same title). This was published in 2006. If Mr. Davenport is like me, it takes a while of incubation before I put it down to paper, and even longer yet that it gets self published by ways of my blog. My guess is that Mr. Davenport had been thinking and talking about the concepts covered in that article long before that article was printed.</p><p>Also of note is that the majority of these articles were originally published in 2013 or before. 1 of the 11 (9%) was published later than 2013, and as a matter of fact, it was in 2017. To me this signifies that we don’t really “get it” yet, and we’re still grasping with what data means in organizations, and what we can do with it.</p><h4>…And We’re Still Talking about Big Data</h4><p>Out of the 11 articles (there are additional briefings that I am not counting) 5 of them have big data in the title or in the subtitle. To me, this says that there are still many people that are unsure of what Big Data is, what it means, and how to “do it”.</p><p>Additionally, many of these articles are “entry level” conceptual propositions for how to think about big data. By no means do I suggest these articles do not have merit, but I think that this suggests that there are many people who are still trying to figure it out. And honestly, I don’t blame them for confusion. There are a lot of terms and concepts, vendors and concepts, and a many ideas of how to do it correctly. Not only are these concepts difficult to imagine, but they are incredibly hard to pull off in the real world, much less get significant value from them. Gartner believes that these types of <a href="http://www.digitaljournal.com/tech-and-science/technology/big-data-strategies-disappoint-with-85-percent-failure-rate/article/508325">projects fail at rates between 60–85%</a>. This is an incredible figure; no wonder we keep talking about big data.</p><h4>Analytics is still the golden egg</h4><p>Along a similar train of thought, I decided to see how many articles had direct references to “analytics”. It was a surprising amount — 54% (6 of 11). Many of these articles extolled the virtues of using analytics to bring greater ROI to the business, and how using more data and algorithms will bring about these returns.</p><p>Again, I think these view points are wrong; I’ve helped plenty of clients get value through data. I think the word of caution I would give it to expect these changes and returns to be 1) linear, and 2) readily apparent. All too often the road to a data driven organization gets bumpy and the path is abandonded. This may be why I (and my colleagues at Red Pill Analytics) recommend clients to start small and grow into larger implementations and systems. And always remember: data can enhance your organization, but it will not save it.</p><h4>More food for thought</h4><p>There were three categories of articles: <em>Strategy</em>, <em>Execution</em> and <em>Talent</em>. These are all important aspects to working in a highly technical field such as data. One thing I will note about the <em>Strategy</em> articles is that they seemed mostly focused on greenfield strategies. Additionally, the <em>Execution</em> and <em>Talent</em> articles were devoid of horror stories of how to claw out of the hole of high turnover, successive project failures, and botched implementations. I think these stories are perhaps the most helpful and need to be the most discussed; we do not learn most from our successes, but rather from the failures that pave the way to these glories.</p><h4>A few last words</h4><p>If you are unfamiliar with what Big Data or Advanced Analytics is, I would recommend getting a copy of the latest HBR OnPoint. It could serve as a useful primer as to what is happening, as it seems nothing new has happened in the last 5 years according to the publication list. However, if you are familiar with this world, I say listen to Master Yoda and “Unlearn what you have learned”. You don’t need big data or advanced analytics to be successful. What you do need is to understand <em>what</em> you want to know, <em>why</em> you want to know it, and <em>how</em> you are going to attain that knowledge. I think the reason we are still having the same discussions we were having 10 years ago (or 20 years ago, or…) is because the fundamental issues are the same. Spoiler alert: there is no magic bullet to answer your questions or give your data meaning. Sometimes big data and advanced analytics are the right tools for the job; sometimes they aren’t. Be sure to pick the right tools, and the right team, for the task at hand.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/1*eLp6aU-J_Tx4iCpjw9rSLQ.gif" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=efae9f0ce06a" width="1" height="1"><hr><p><a href="https://blog.redpillanalytics.com/whats-the-big-deal-with-big-data-efae9f0ce06a">What’s the Big Deal with Big Data?</a> was originally published in <a href="https://blog.redpillanalytics.com">Red Pill Analytics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p> Phil Goerdt https://medium.com/p/efae9f0ce06a Fri Jan 19 2018 11:52:05 GMT-0500 (EST) Real-time Sailing Yacht Performance - Getting Started (Part 1) http://www.rittmanmead.com/blog/2018/01/real-time-yacht-performance/ <p>In this series of articles, I intend to look at collecting and analysing our yacht’s data. I aim to show how a number of technologies can be used to achieve this and the thought processes around the build and exploration of the data. Ultimately, I want to improve our sailing performance with data, not a new concept for professional teams but well I have a limited amount of hardware and funds, unlike <a href="https://www.oracle.com/corporate/oracle-team-usa/index.html">Oracle</a> it seems, time for a bit of DIY!</p> <p>In this article, I introduce some concepts and terms then I'll start cleaning and exploring the data.</p> <h2 id="background">Background</h2> <p>I have owned a <a href="http://www.humphreysdesign.com/840/sigma-400/">Sigma 400</a> sailing yacht for over twelve years and she is used primarily for cruising but every now and then we do a bit of offshore racing. </p> <p>In the last few years we have moved from paper charts and a very much manual way of life to <a href="https://www.navionics.com/gbr/apps/navionics-boating">electronic charts</a> and IOS apps for navigation. </p> <p>In 2017 we started to use weather modelling software to predict the most optimal route of a passage taking wind, tide and estimated boat performance (polars) into consideration.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/01/Combined-Chart---Weather.png" alt=""></p> <p style="clear: both;"> The predicted routes are driven in part by a boat's polars, the original "polars" are a set of theoretical calculations created by the boat’s designer indicating/defining what the boat should do at each wind speed and angle of sailing. Polars give us a plot of the boat's speed given a true wind speed and angle. This in turn informs us of the optimal speed the boat could achieve at any particular angle to wind and wind speed (not taking into consideration helming accuracy, sea state, condition of sails and sail trim - It may be possible for me to derive different polars for different weather conditions). Fundamentally, polars will also give us an indication of the most optimal angle to wind to get to our destination (velocity made good).</p> <p>The polars we use at the moment are based on a similar boat to the Sigma 400 but are really a best guess. I want our polars to be more accurate. I would also like to start tracking the boats performance real-time and post passage for further analysis.</p> <p>The purpose of this blog is to use our boats instrument data to create accurate polars for a number of conditions and get a better understanding of our boats performance at each point of sail. I would also see what can be achieved with the AIS data. I intend to use Python to check and decode the data. I will look at a number of tools to store, buffer, visualise and analyse the outputs.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/01/Combined-Polar-Images.png" alt=""></p> <p style="clear: both;"> </p><p>So let’s look at the technology on-board. </p> <h2 id="instrumentationarchitecture">Instrumentation Architecture</h2> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/01/instruments-architecture-final.jpg" alt=""></p> <p>The instruments are by <a href="http://www.raymarine.com/">Raymarine</a>. We have a wind vane, GPS, speed sensor, depth sounder and sea temperature gauge, electronic compass, gyroscope, and rudder angle reader. These are all fed into a central course computer. Some of the instrument displays share and enrich the data calculating such things as apparent wind angles as an example. All the data travels through a proprietary Raymarine messaging system called SeaTalk. To allow Raymarine instruments to interact with other instrumentation there is an <a href="https://en.wikipedia.org/wiki/NMEA_0183">NMEA-0183</a> port. NMEA-0183 is a well-known communication protocol and is fairly well documented so this is the data I need to extract from the system. I currently have an NMEA-0183 cable connecting the Raymarine instruments to an <a href="https://en.wikipedia.org/wiki/Automatic_identification_system">AIS</a> transponder. The AIS transponder includes a Wireless router. The wireless router enables me to connect portable devices to the instrumentation.</p> <p>The first task is to start looking at the data and get an understanding of what needs to be done before I can start analysing.</p> <h2 id="analysingthedata">Analysing the data</h2> <p>There is a USB connection from the AIS hub however the instructions do warn that this should only be used during installation. I did spool some data from the USB port, it seemed to work OK. I could connect directly to the NMEA-0183 output however that would require me to do some wiring so will look at that if the reliability of the wireless causes issues. The second option was to use the wireless connection. I start by spooling the data to a log file using nc (nc is basically OSX's version of <a href="https://linux.die.net/man/1/nc">netcat</a>, a TCP and UDP tool).</p> <p><strong>Spooling the data to a log file</strong></p> <pre><code>nc -p 1234 192.168.1.1 2000 > instrument.log</code></pre> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/01/nc-to-file-direct.png" alt=""></p> <p>The spooled data gave me a clear indication that there would need to be some sanity checking of the data before it would be useful. The data is split into a number of different message types each consisting of a different structure. I will convert these messages into a JSON format so that the messages are more readable downstream. In the example below the timestamps displayed are attached using awk but my Python script will handle any enrichment as I build out.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/01/Example-Data.png" alt=""></p> <p>The data is comma separated so this makes things easy and there a number of good websites that <a href="http://home.btconnect.com/Amaya/Example%20NMEA%20Sentences.pdf">describe</a> the contents of the messages. Looking at the data using a series of awk commands I clearly identify three main types of messages. GPS, AIS and Integrated instrument messages. Each message ends in a two-digit hex code this can be XOR'd to validate the message.</p> <p><strong>Looking at an example wind messages</strong></p> <p>We get two messages related to the wind true and apparent the data is the same because the boat was stationary.</p> <pre><code>$IIMWV,180.0,R,3.7,N,A*30 $IIMWV,180.0,T,3.8,N,A*30</code></pre> <p>These are <strong>I</strong>ntegrated <strong>I</strong>nstrument <strong>M</strong>ast <strong>W</strong>ind <strong>V</strong>ain (IIMWV) * I have made an assumption about the meaning of M so if you are an expert in these messages feel free to correct me ;-)*</p> <p><em>These messages break down to:</em></p> <ol> <li>$IIMWV II Talker, MWV Sentence </li> <li>180.0 Wind Angle 0 - 359 </li> <li>R Relative (T = True) </li> <li>3.7 Wind Speed </li> <li>N Wind Speed Units Knots (N = KPH, M = MPH) </li> <li>A Status (A= Valid) </li> <li>*30 Checksums</li> </ol> <p><em>And in English (ish)</em></p> <p>180.0 Degrees Relative wind speed 1.9 Knots.</p> <p><strong>Example corrupted message</strong></p> <pre><code>$GPRMC,100851.00,A,5048.73249,N,00005.86148,W,0.01**$GPGGA**,100851.00,5048.73249,N,00005.8614$GPGLL,5048.73249,N,00005.86148,W,100851.0</code></pre> <p>Looks like the message failed to get a new line. I notice a number of other types of incomplete or corrupted messages so checking them will be an essential part of the build.</p> <h2 id="creatingamessagereader">Creating a message reader</h2> <p>I don't really want to sit on the boat building code. I need to be doing this while traveling and at home when I get time. So, spooling half an hour of data to a log file gets me started. I can use Python to read from the file and once up and running spool the log file to a local TCP/IP port and read using Python socket library.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2018/01/python-to-file.png" alt=""></p> <p>Firstly, I read the log file and loop through the messages, each message I check to see if it's valid using the checksum, line length. I used this to log the number of messages in error etc. I have posted the test function, I'm sure there are better ways to write the code but it works.</p> <pre><code>#DEF Function to test message def is_message_valid (orig_line): #check if hash is valid #set variables x = 1 check = 0 received_checksum = 0 line_length = len(orig_line.strip()) while (x <= line_length):="" current_char="orig_line[x]" #checksum="" is="" always="" two="" chars="" after="" the="" *="" if="" "*":="" received_checksum="orig_line[x+1]" +="" orig_line[x+2]="" #check="" where="" we="" are="" there="" more="" to="" decode="" then="" #have="" take="" into="" account="" new="" line="" line_length=""> (x+3): check = 0 #no need to continue to the end of the #line either error or have checksum break check = check^ord(current_char) x = x + 1; if format(check,"2X") == received_checksum: #substring the new line for printing #print "Processed nmea line >> " + orig_line[:-1] + " Valid message" _Valid = 1 else: #substring the new line for printing _Valid = 0 return _Valid</=></code></pre> <p>Now for the translation of messages. There are a number of example Python packages in GitHub that translate NMEA messages but I am only currently interested in specific messages, I also want to build appropriate JSON so feel I am better writing this from scratch. Python has JSON libraries so fairly straight forward once the message is defined. I start by looking at the wind and depth messages. I'm not currently seeing any speed messages hopefully because the boat wasn't moving.</p> <pre><code>def convert_iimwv_json (orig_line): #iimwv wind instrumentation column_list = orig_line.split(",") #star separates the checksum from status status_check_sum = column_list[5].split("*") checksum_value = status_check_sum[1] json_str = {'message_type' : column_list[0], 'wind_angle' : column_list[1], 'relative' : column_list[2], 'wind_speed' : column_list[3], 'wind_speed_units' : column_list[4], 'status' : status_check_sum[0], 'checksum' : checksum_value[0:2]} json_dmp = json.dumps(json_str) json_obj = json.loads(json_dmp) return json_str</code></pre> <p>I now have a way of checking, reading and converting the message to JSON from a log file. Switching from reading a file to to using the Python socket library I can read the stream directly from a TCP/IP port. Using nc it's possible to simulate the message being sent from the instruments by piping the log file to a port.</p> <p><em>Opening port 1234 and listening for terminal input</em></p> <pre><code>nc -l 1234</code></pre> <blockquote> <p><em>Having spoken to some experts from <a href="http://digitalyacht.co.uk/">Digital Yachts</a> it maybe that the missing messages are because Raymarine SeakTalk is not transmitting an NMEA message for speed and a number of other readings. The way I have wired up the NMEA inputs and outputs to the AIS hub may also be causing the doubling up of messages and apparent corruptions. I need more kit! A bi-direction SeaTalk to NMEA <a href="http://digitalyacht.co.uk/product/st-nmea-iso/">converter</a>.</em></p> </blockquote> <p>In the next article, I discuss the use of Kafka in the architecture. I want to buffer all my incoming raw messages. If I store all the incoming I can build out the analytics over time i.e as I decode each message type. I will also set about creating a near real time dashboard to display the incoming metrics. The use of Kafka will give me scalability in the model. I'm particularly thinking of <a href="http://www.roundtheisland.org.uk/web/code/php/main_c.php?map=rir18&amp;ui=rir5&amp;style=std&amp;override=&amp;section=home">Round the Island Race</a> 1,800 boats a good number of these will be transmitting AIS data. </p> <br> <img src="http://www.rittmanmead.com/blog/content/images/2018/01/python-to-kafka.png" alt=""><p></p> Paul Shilling 1e6cb880-f516-4a91-9c3d-e10fae9af582 Fri Jan 19 2018 04:54:00 GMT-0500 (EST) Essbase 6x Lift & Shift to the Cloud https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/ <p>Background: I recently performed a POC where the customer was running Essbase 6.5 (yes…I was in junior high when 6 came out!) and wanted to see the level of complexity of migrating to the cloud so they could utilize BI and DV with Essbase (as well as the additional Essbase functionality).</p> <p>I am cautious when I tell people that it’s pretty simple to move to the Essbase cloud because it seems each organization has a ‘gotcha’ of some sort. This one was no different… Because they were using Essbase 6, I could not use some of the new, fancy tools to extract Essbase artifacts to a cloud ready tool because…it’s old. Just to open the outline was a bit of work itself because I didn’t have a ready on-premises Essbase environment available and I wasn’t even sure if a version 6 outline would load to, say, 11.1.2.4. I even tried creating a shell application in EssCS to see if I could import an otl file, but OAC does not accept that as a file type to upload…</p> <p>(Note that you cannot use the OAC “<a href="https://realtrigeek.com/2017/03/21/migrating-an-on-premises-essbase-cube-to-the-cloud/">dbxtool</a>” to extract an outline from an OP version of an Essbase cube that is version 6.)</p> <p>Finally, I reached out to an Essbase friend for a copy of AppMan (Application Manager) from back in the version 6 days and he came through to save the day! I was able to view the outline for any gotchas (none, and didn’t expect any). Since the otl didn’t load, I was curious is my rules files would (1) load and (2) be able to be used without modification. The answer was yes to both! This made loading dimensions and data MUCH easier since the older style is apparently still in use in EssCS… (Don’t even ask me about creating new rules files in EssCS…)</p> <p>Below is how I planned to tackle the lift and shift (LnS) from Essbase 6.5 to EssCS:</p> <ol start="1"> <li>Open otl in AppMan to verify structure and outline aggregation.</li> <li>What dimensions are static and need to be built manually either in EssCS or in the Cube Builder worksheet?</li> <li>Create the static dimensions in the Cube Builder workbook.</li> <li>Load the Excel workbook to OAC including the skeleton dimensions.</li> <li>Load the dynamic member text files and rules files to OAC</li> <li>Load data</li> <li>Create and run “default” aggregation</li> <li>Check to see if data aggregated correctly</li> </ol> <p>I had the customer export the artifacts from their Essbase cube:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image001.png"><img data-attachment-id="1908" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image001-13/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image001.png?w=840" data-orig-size="624,479" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image001" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image001.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image001.png?w=840?w=624" class="alignnone size-full wp-image-1908" src="https://epmqueen.files.wordpress.com/2018/01/image001.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image001.png 624w, https://epmqueen.files.wordpress.com/2018/01/image001.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image001.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Note that is cube is, what I referred to as, “Vanilla”. They said “Kindergarten”…not my words! J</p> <p>Okay, to my planned attack method…</p> <p>In AppMan (thanks, <a href="http://www.cubecoder.com/"> CubeCoderDotCom</a>!), I see that most dimensions are all summed to the top. The only one that is not is the Scenario dimension when comparing the Actual vs Budget.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image002.png"><img data-attachment-id="1909" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image002-10/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image002.png?w=840" data-orig-size="624,395" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image002" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image002.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image002.png?w=840?w=624" class="alignnone size-full wp-image-1909" src="https://epmqueen.files.wordpress.com/2018/01/image002.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image002.png 624w, https://epmqueen.files.wordpress.com/2018/01/image002.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image002.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Of these dimensions, the following are static versus dynamic, meaning updated each time the cube is updated. I’ve also added if each dimension is Dense or Sparse as an FYI.</p> <ul> <li>Fund – Static; Dense</li> <li>Cost – Dynamic; Sparse</li> <li>Organizational – Dynamic; Sparse</li> <li>Functional – Dynamic; Sparse</li> <li>Responsible – Dynamic; Sparse</li> <li>Year – Static; Dense</li> <li>Scenario – Static; Dense</li> </ul> <p>I download the BSO outline workbook to have a place to start:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image003.png"><img data-attachment-id="1910" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image003-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image003.png?w=840" data-orig-size="624,197" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image003" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image003.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image003.png?w=840?w=624" class="alignnone size-full wp-image-1910" src="https://epmqueen.files.wordpress.com/2018/01/image003.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image003.png 624w, https://epmqueen.files.wordpress.com/2018/01/image003.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image003.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Next, I started filling it in:</p> <p>Essbase.Cube worksheet:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image004.png"><img data-attachment-id="1911" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image004-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image004.png?w=840" data-orig-size="624,781" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image004" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image004.png?w=840?w=240" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image004.png?w=840?w=624" class="alignnone size-full wp-image-1911" src="https://epmqueen.files.wordpress.com/2018/01/image004.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image004.png 624w, https://epmqueen.files.wordpress.com/2018/01/image004.png?w=120 120w, https://epmqueen.files.wordpress.com/2018/01/image004.png?w=240 240w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Cube.Settings worksheet:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image005.png"><img data-attachment-id="1912" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image005-13/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image005.png?w=840" data-orig-size="624,420" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image005" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image005.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image005.png?w=840?w=624" class="alignnone size-full wp-image-1912" src="https://epmqueen.files.wordpress.com/2018/01/image005.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image005.png 624w, https://epmqueen.files.wordpress.com/2018/01/image005.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image005.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Note that I changed the “Aggregate missing values” and “Two-Pass calculation” to “Yes” and also added our Alternate Alias Table so we have a placeholder.</p> <p>At this time, I am not going to add any Generation names to my levels, so I cleared the Cube.Generations worksheet.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image006.png"><img data-attachment-id="1913" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image006-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image006.png?w=840" data-orig-size="621,241" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image006" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image006.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image006.png?w=840?w=621" class="alignnone size-full wp-image-1913" src="https://epmqueen.files.wordpress.com/2018/01/image006.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image006.png 621w, https://epmqueen.files.wordpress.com/2018/01/image006.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image006.png?w=300 300w" sizes="(max-width: 621px) 100vw, 621px" /></a></p> <p>Now we start the dimensions… Since all 3 of our dense dimensions are stored, I’m going to go ahead and build out the outline while for the remaining, sparse dimensions, I’m going to create the shell so we can load them later via text and rules files.</p> <p>Dim.Year:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image007.png"><img data-attachment-id="1914" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image007-10/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image007.png?w=840" data-orig-size="624,501" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image007" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image007.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image007.png?w=840?w=624" class="alignnone size-full wp-image-1914" src="https://epmqueen.files.wordpress.com/2018/01/image007.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image007.png 624w, https://epmqueen.files.wordpress.com/2018/01/image007.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image007.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Dim.Scenario</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image008.png"><img data-attachment-id="1915" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image008-13/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image008.png?w=840" data-orig-size="624,327" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image008" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image008.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image008.png?w=840?w=624" class="alignnone size-full wp-image-1915" src="https://epmqueen.files.wordpress.com/2018/01/image008.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image008.png 624w, https://epmqueen.files.wordpress.com/2018/01/image008.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image008.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Dim.Fund</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image009.png"><img data-attachment-id="1916" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image009-13/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image009.png?w=840" data-orig-size="624,241" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image009" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image009.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image009.png?w=840?w=624" class="alignnone size-full wp-image-1916" src="https://epmqueen.files.wordpress.com/2018/01/image009.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image009.png 624w, https://epmqueen.files.wordpress.com/2018/01/image009.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image009.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Dim.Cost</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image010.png"><img data-attachment-id="1917" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image010-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image010.png?w=840" data-orig-size="602,240" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image010" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image010.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image010.png?w=840?w=602" class="alignnone size-full wp-image-1917" src="https://epmqueen.files.wordpress.com/2018/01/image010.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image010.png 602w, https://epmqueen.files.wordpress.com/2018/01/image010.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image010.png?w=300 300w" sizes="(max-width: 602px) 100vw, 602px" /></a></p> <p>Dim.Organizational</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image011.png"><img data-attachment-id="1918" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image011-12/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image011.png?w=840" data-orig-size="624,195" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image011" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image011.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image011.png?w=840?w=624" class="alignnone size-full wp-image-1918" src="https://epmqueen.files.wordpress.com/2018/01/image011.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image011.png 624w, https://epmqueen.files.wordpress.com/2018/01/image011.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image011.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Dim.Functional</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image012.png"><img data-attachment-id="1919" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image012-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image012.png?w=840" data-orig-size="624,259" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image012" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image012.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image012.png?w=840?w=624" class="alignnone size-full wp-image-1919" src="https://epmqueen.files.wordpress.com/2018/01/image012.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image012.png 624w, https://epmqueen.files.wordpress.com/2018/01/image012.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image012.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Dim.Responsible</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image013.png"><img data-attachment-id="1920" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image013-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image013.png?w=840" data-orig-size="624,287" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image013" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image013.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image013.png?w=840?w=624" class="alignnone size-full wp-image-1920" src="https://epmqueen.files.wordpress.com/2018/01/image013.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image013.png 624w, https://epmqueen.files.wordpress.com/2018/01/image013.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image013.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>I deleted the data worksheet since we will be loading that via OAC.</p> <p><img data-attachment-id="1921" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image014-11/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image014.png?w=840" data-orig-size="624,27" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image014" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image014.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image014.png?w=840?w=624" class="alignnone size-full wp-image-1921" src="https://epmqueen.files.wordpress.com/2018/01/image014.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image014.png 624w, https://epmqueen.files.wordpress.com/2018/01/image014.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image014.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></p> <p>Let’s see how good my skills are with an upload of this workbook to OAC.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image015.png"><img data-attachment-id="1922" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image015-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image015.png?w=840" data-orig-size="624,291" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image015" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image015.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image015.png?w=840?w=624" class="alignnone size-full wp-image-1922" src="https://epmqueen.files.wordpress.com/2018/01/image015.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image015.png 624w, https://epmqueen.files.wordpress.com/2018/01/image015.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image015.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>An error: Property “Dimension Name” must have value in sheet “Cube.Generations”.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image016.png"><img data-attachment-id="1923" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image016-10/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image016.png?w=840" data-orig-size="624,257" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image016" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image016.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image016.png?w=840?w=624" class="alignnone size-full wp-image-1923" src="https://epmqueen.files.wordpress.com/2018/01/image016.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image016.png 624w, https://epmqueen.files.wordpress.com/2018/01/image016.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image016.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Let me remove the Cube.Generations worksheet to see if it will take:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image017.png"><img data-attachment-id="1924" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image017-7/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image017.png?w=840" data-orig-size="624,255" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image017" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image017.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image017.png?w=840?w=624" class="alignnone size-full wp-image-1924" src="https://epmqueen.files.wordpress.com/2018/01/image017.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image017.png 624w, https://epmqueen.files.wordpress.com/2018/01/image017.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image017.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Darn it: Invalid value “Replace” for property “Incremental Mode” in sheet “Dim.Year”; expected values Remove Unspecified, Merge.</p> <p>I really thought that Replace was an option, but when I go to the “<a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/essug/understanding-dimension-worksheets.html">Understanding Dimension Worksheets</a>” in the documentation, clearly it is not an option.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image018.png"><img data-attachment-id="1925" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image018-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image018.png?w=840" data-orig-size="624,145" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image018" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image018.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image018.png?w=840?w=624" class="alignnone size-full wp-image-1925" src="https://epmqueen.files.wordpress.com/2018/01/image018.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image018.png 624w, https://epmqueen.files.wordpress.com/2018/01/image018.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image018.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Okay, fine. I’ll use Merge on all the worksheets.</p> <p>Let’s try this again.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image019.png"><img data-attachment-id="1926" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image019-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image019.png?w=840" data-orig-size="624,245" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image019" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image019.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image019.png?w=840?w=624" class="alignnone size-full wp-image-1926" src="https://epmqueen.files.wordpress.com/2018/01/image019.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image019.png 624w, https://epmqueen.files.wordpress.com/2018/01/image019.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image019.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Phew. Past the first hurdle.</p> <p>Aaaaand past the second.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image020.png"><img data-attachment-id="1927" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image020-9/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image020.png?w=840" data-orig-size="624,184" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image020" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image020.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image020.png?w=840?w=624" class="alignnone size-full wp-image-1927" src="https://epmqueen.files.wordpress.com/2018/01/image020.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image020.png 624w, https://epmqueen.files.wordpress.com/2018/01/image020.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image020.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Now we want to load up the dimension, data, and rules files to our application.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image021.png"><img data-attachment-id="1928" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image021-9/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image021.png?w=840" data-orig-size="624,292" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image021" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image021.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image021.png?w=840?w=624" class="alignnone size-full wp-image-1928" src="https://epmqueen.files.wordpress.com/2018/01/image021.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image021.png 624w, https://epmqueen.files.wordpress.com/2018/01/image021.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image021.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Note that some rules and text files already exist. These were created as part of our Excel workbook upload process.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image022.png"><img data-attachment-id="1929" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image022-7/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image022.png?w=840" data-orig-size="624,343" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image022" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image022.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image022.png?w=840?w=624" class="alignnone size-full wp-image-1929" src="https://epmqueen.files.wordpress.com/2018/01/image022.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image022.png 624w, https://epmqueen.files.wordpress.com/2018/01/image022.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image022.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Let’s upload some files…10 at a time…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image023.png"><img data-attachment-id="1930" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image023-7/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image023.png?w=840" data-orig-size="547,496" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image023" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image023.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image023.png?w=840?w=547" class="alignnone size-full wp-image-1930" src="https://epmqueen.files.wordpress.com/2018/01/image023.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image023.png 547w, https://epmqueen.files.wordpress.com/2018/01/image023.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image023.png?w=300 300w" sizes="(max-width: 547px) 100vw, 547px" /></a></p> <p>Here are my first 10…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image024.png"><img data-attachment-id="1931" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image024-7/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image024.png?w=840" data-orig-size="624,388" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image024" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image024.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image024.png?w=840?w=624" class="alignnone size-full wp-image-1931" src="https://epmqueen.files.wordpress.com/2018/01/image024.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image024.png 624w, https://epmqueen.files.wordpress.com/2018/01/image024.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image024.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Click Upload…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image025.png"><img data-attachment-id="1932" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image025-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image025.png?w=840" data-orig-size="464,532" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image025" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image025.png?w=840?w=262" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image025.png?w=840?w=464" class="alignnone size-full wp-image-1932" src="https://epmqueen.files.wordpress.com/2018/01/image025.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image025.png 464w, https://epmqueen.files.wordpress.com/2018/01/image025.png?w=131 131w, https://epmqueen.files.wordpress.com/2018/01/image025.png?w=262 262w" sizes="(max-width: 464px) 100vw, 464px" /></a></p> <p>And I should get a successful message:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image026.png"><img data-attachment-id="1933" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image026-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image026.png?w=840" data-orig-size="284,481" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image026" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image026.png?w=840?w=177" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image026.png?w=840?w=284" class="alignnone size-full wp-image-1933" src="https://epmqueen.files.wordpress.com/2018/01/image026.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image026.png 284w, https://epmqueen.files.wordpress.com/2018/01/image026.png?w=89 89w" sizes="(max-width: 284px) 100vw, 284px" /></a></p> <p>Now let me load up the rest…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image027.png"><img data-attachment-id="1934" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image027-7/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image027.png?w=840" data-orig-size="624,339" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image027" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image027.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image027.png?w=840?w=624" class="alignnone size-full wp-image-1934" src="https://epmqueen.files.wordpress.com/2018/01/image027.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image027.png 624w, https://epmqueen.files.wordpress.com/2018/01/image027.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image027.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Now I’m going to go to “Jobs” so I can load the dimensions and data.</p> <p>Click on “Jobs”, then “New Job”, then choose the correct rules file to go with your data file.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image028.png"><img data-attachment-id="1935" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image028-8/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image028.png?w=840" data-orig-size="625,279" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image028" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image028.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image028.png?w=840?w=625" class="alignnone size-full wp-image-1935" src="https://epmqueen.files.wordpress.com/2018/01/image028.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image028.png 625w, https://epmqueen.files.wordpress.com/2018/01/image028.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image028.png?w=300 300w" sizes="(max-width: 625px) 100vw, 625px" /></a></p> <p>Click “Execute”.</p> <p>Okay, it has started. We can click “Refresh” until it is finished to see if it worked or failed.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image029.png"><img data-attachment-id="1936" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image029-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image029.png?w=840" data-orig-size="624,88" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image029" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image029.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image029.png?w=840?w=624" class="alignnone size-full wp-image-1936" src="https://epmqueen.files.wordpress.com/2018/01/image029.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image029.png 624w, https://epmqueen.files.wordpress.com/2018/01/image029.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image029.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>We are good!</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image030.png"><img data-attachment-id="1937" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image030-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image030.png?w=840" data-orig-size="624,131" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image030" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image030.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image030.png?w=840?w=624" class="alignnone size-full wp-image-1937" src="https://epmqueen.files.wordpress.com/2018/01/image030.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image030.png 624w, https://epmqueen.files.wordpress.com/2018/01/image030.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image030.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>I’m going to finish loading the remaining dimensions and data files…</p> <p>Uh oh. I got an error: Incorrect Parent for Member.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image031.png"><img data-attachment-id="1938" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image031-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image031.png?w=840" data-orig-size="624,245" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image031" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image031.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image031.png?w=840?w=624" class="alignnone size-full wp-image-1938" src="https://epmqueen.files.wordpress.com/2018/01/image031.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image031.png 624w, https://epmqueen.files.wordpress.com/2018/01/image031.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image031.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Lemme check that out…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image032.png"><img data-attachment-id="1939" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image032-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image032.png?w=840" data-orig-size="624,232" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image032" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image032.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image032.png?w=840?w=624" class="alignnone size-full wp-image-1939" src="https://epmqueen.files.wordpress.com/2018/01/image032.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image032.png 624w, https://epmqueen.files.wordpress.com/2018/01/image032.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image032.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Ah. I see two records where the parent and child are the same. Lemme remove these, reload the text file, then reload the dimension.</p> <p>It’s going to ask me if I want to replace the file…yep.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image033.png"><img data-attachment-id="1940" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image033-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image033.png?w=840" data-orig-size="457,285" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image033" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image033.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image033.png?w=840?w=457" class="alignnone size-full wp-image-1940" src="https://epmqueen.files.wordpress.com/2018/01/image033.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image033.png 457w, https://epmqueen.files.wordpress.com/2018/01/image033.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image033.png?w=300 300w" sizes="(max-width: 457px) 100vw, 457px" /></a></p> <p>Hooray for green check marks.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image034.png"><img data-attachment-id="1941" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image034-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image034.png?w=840" data-orig-size="624,239" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image034" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image034.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image034.png?w=840?w=624" class="alignnone size-full wp-image-1941" src="https://epmqueen.files.wordpress.com/2018/01/image034.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image034.png 624w, https://epmqueen.files.wordpress.com/2018/01/image034.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image034.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>If you remember in previous versions of Essbase, you could right-click on a database to perform a default aggregation of the cube. Well, we don’t have that option in the cloud so we have to create a calculation. I created a basic calc to do just that:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image035.png"><img data-attachment-id="1942" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image035-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image035.png?w=840" data-orig-size="624,133" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image035" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image035.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image035.png?w=840?w=624" class="alignnone size-full wp-image-1942" src="https://epmqueen.files.wordpress.com/2018/01/image035.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image035.png 624w, https://epmqueen.files.wordpress.com/2018/01/image035.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image035.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Let’s go back to “Jobs” and run the calc.</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image036.png"><img data-attachment-id="1943" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image036-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image036.png?w=840" data-orig-size="484,631" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image036" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image036.png?w=840?w=230" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image036.png?w=840?w=484" class="alignnone size-full wp-image-1943" src="https://epmqueen.files.wordpress.com/2018/01/image036.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image036.png 484w, https://epmqueen.files.wordpress.com/2018/01/image036.png?w=115 115w, https://epmqueen.files.wordpress.com/2018/01/image036.png?w=230 230w" sizes="(max-width: 484px) 100vw, 484px" /></a></p> <p>Got the all clear…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image037.png"><img data-attachment-id="1944" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image037-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image037.png?w=840" data-orig-size="624,117" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image037" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image037.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image037.png?w=840?w=624" class="alignnone size-full wp-image-1944" src="https://epmqueen.files.wordpress.com/2018/01/image037.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image037.png 624w, https://epmqueen.files.wordpress.com/2018/01/image037.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image037.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Now, let’s create a connection to the cube to make sure there is data (you could also do Smart View or BI in OAC):</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image038.png"><img data-attachment-id="1945" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image038-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image038.png?w=840" data-orig-size="624,441" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image038" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image038.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image038.png?w=840?w=624" class="alignnone size-full wp-image-1945" src="https://epmqueen.files.wordpress.com/2018/01/image038.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image038.png 624w, https://epmqueen.files.wordpress.com/2018/01/image038.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image038.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Aaaand create a new Data Source:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image039.png"><img data-attachment-id="1946" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image039-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image039.png?w=840" data-orig-size="624,275" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image039" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image039.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image039.png?w=840?w=624" class="alignnone size-full wp-image-1946" src="https://epmqueen.files.wordpress.com/2018/01/image039.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image039.png 624w, https://epmqueen.files.wordpress.com/2018/01/image039.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image039.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Choose our new cube:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image040.png"><img data-attachment-id="1947" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image040-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image040.png?w=840" data-orig-size="624,289" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image040" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image040.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image040.png?w=840?w=624" class="alignnone size-full wp-image-1947" src="https://epmqueen.files.wordpress.com/2018/01/image040.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image040.png 624w, https://epmqueen.files.wordpress.com/2018/01/image040.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image040.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Voila</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image041.png"><img data-attachment-id="1948" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image041-5/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image041.png?w=840" data-orig-size="624,433" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image041" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image041.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image041.png?w=840?w=624" class="alignnone size-full wp-image-1948" src="https://epmqueen.files.wordpress.com/2018/01/image041.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image041.png 624w, https://epmqueen.files.wordpress.com/2018/01/image041.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image041.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>From here we can create a DV project or BI Analysis</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image042.png"><img data-attachment-id="1949" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image042-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image042.png?w=840" data-orig-size="559,371" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image042" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image042.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image042.png?w=840?w=559" class="alignnone size-full wp-image-1949" src="https://epmqueen.files.wordpress.com/2018/01/image042.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image042.png 559w, https://epmqueen.files.wordpress.com/2018/01/image042.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image042.png?w=300 300w" sizes="(max-width: 559px) 100vw, 559px" /></a></p> <p>I chose Analysis and the following elements as a basic check of data:</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image043.png"><img data-attachment-id="1950" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image043-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image043.png?w=840" data-orig-size="624,276" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image043" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image043.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image043.png?w=840?w=624" class="alignnone size-full wp-image-1950" src="https://epmqueen.files.wordpress.com/2018/01/image043.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image043.png 624w, https://epmqueen.files.wordpress.com/2018/01/image043.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image043.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>And when I go to Results, I see values I expected. Great! I can, obviously, tailor things from here, but I have lifted and shifted my on-premises Essbase cube to the cloud!</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image044.png"><img data-attachment-id="1951" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image044-3/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image044.png?w=840" data-orig-size="604,569" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image044" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image044.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image044.png?w=840?w=604" class="alignnone size-full wp-image-1951" src="https://epmqueen.files.wordpress.com/2018/01/image044.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image044.png 604w, https://epmqueen.files.wordpress.com/2018/01/image044.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image044.png?w=300 300w" sizes="(max-width: 604px) 100vw, 604px" /></a></p> <p>Now, what about automation? The version I am using does not have MaxL (the current version does, however), so I’m going to use Essbase CLI (command line interface).</p> <p><strong>Note: This will not work as a batch script!</strong> You will need to create another batch script to call the batch processing items. This screenshot is to give you an idea of what the automation scripting looks like. It will not work if you copy and paste it, changing your values. J</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image045.png"><img data-attachment-id="1952" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image045-6/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image045.png?w=840" data-orig-size="624,688" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image045" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image045.png?w=840?w=272" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image045.png?w=840?w=624" class="alignnone size-full wp-image-1952" src="https://epmqueen.files.wordpress.com/2018/01/image045.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image045.png 624w, https://epmqueen.files.wordpress.com/2018/01/image045.png?w=136 136w, https://epmqueen.files.wordpress.com/2018/01/image045.png?w=272 272w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>And the end of the script…</p> <p><a href="https://epmqueen.files.wordpress.com/2018/01/image046.png"><img data-attachment-id="1953" data-permalink="https://realtrigeek.com/2018/01/18/essbase-6x-lift-shift-to-the-cloud/image046-4/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/image046.png?w=840" data-orig-size="624,441" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image046" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/image046.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/image046.png?w=840?w=624" class="alignnone size-full wp-image-1953" src="https://epmqueen.files.wordpress.com/2018/01/image046.png?w=840" alt="" srcset="https://epmqueen.files.wordpress.com/2018/01/image046.png 624w, https://epmqueen.files.wordpress.com/2018/01/image046.png?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/image046.png?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>PS – You may have noticed a .alt file in the export from the customer, an alternate alias file. While OAC does not accept a .alt file to load to the files, you can use MaxL to load the alias file to the outline. My version of OAC did not have this functionality at the time which is why it was not shown. To be updated later!</p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1907 Thu Jan 18 2018 13:33:09 GMT-0500 (EST) The Only Thing Constant is Change https://realtrigeek.com/2018/01/16/the-only-thing-constant-is-change/ <p>Heraclitus was and is still correct. Seems that whenever I make a statement regarding permanence, I am forced to retract. That&#8217;s not always a bad thing. If I have talked to any of you over the past couple years, you have heard me state how much I loved working at Oracle and how I could see myself retiring there in 20 years. I loved my job &#8211; Public Sector BI and Analytics pre-sales &#8211; and the people I worked with/for. However, life presents interesting opportunities sometimes.</p> <p>I started out at Oracle focused on BICS and OBIEE. I had gotten pretty burnt out on EPM consulting and wanted to work with new technology and with scenarios where I could fully use my undergraduate degree. Although I used the Information Systems part of my degree regularly, I really missed not using my Quantitative Analysis degree. My position at and the direction of analytics at Oracle afforded me the opportunity to do statistics as part of my job as well as use the R training I received in college (although I had to relearn the code basics as that was 14 years ago&#8230;). I remembered how much I loved analytics. I loved the math and visualizations. I loved working with organizations that were trying to implement a new or upgraded BI and/or analytics system. I really enjoyed presenting Data Visualization and watching people&#8217;s eyes light up when they saw how easy it was to use and build visualizations from an Excel document. I loved working with the DoD and Federal teams. I felt like I was back at home with my &#8220;people&#8221;. The Sales Reps I worked with were top notch. My teammates were fun, driven, exciting, and hard-working. There was never any competition, only collaboration. I loved my job. In fact, it was the best 2 years of my career and I hope the rest of my career will live up to my time at Oracle as I never felt I was going to work one day in the 2 years as an employee.</p> <p>But sometimes an opportunity comes up out of the blue for you to stretch your wings a bit and throws you off the course you had planned through retirement. Starting January 18th, I will be the VP of BI and Analytics for <a href="http://www.accelytics.com" target="_blank" rel="noopener">Accelytics</a>. I expect this to be an interesting position as I will be building up the BI and analytics team and working with customers implementing these tools. I&#8217;ll be working with Oracle Analytics Cloud immediately and that excites me given the tool offering is still less than a year old and evolving rapidly. I hope to have more time to dedicate to writing more OAC blog posts. I&#8217;ll still be involved in the conference world so I&#8217;m not going anywhere! If anything, you may see/hear more from me, like back in my pre-Oracle days. I could not be more thrilled that I am still working with Oracle technology. Accelytics is an Anaplan partner and I look forward to learning that technology, as well. Always good and fun to learn new technologies!</p> <p>With that said, I hope you&#8217;ll welcome me back to the Oracle partner/customer world with open arms. I&#8217;m excited to be back and continue my work with and for Oracle with a partner for the community!</p> <p>&nbsp;</p> <p><span style="text-decoration:underline;">Upcoming Conferences and Presentations:</span></p> <p><a href="https://www.eventbrite.com/e/inoug-january-2018-meeting-jim-czuprynski-michael-messina-sarah-zumbrum-tickets-41560616924?aff=es2" target="_blank" rel="noopener">Indiana Oracle Users Group</a>: January 26, 2018, presenting &#8220;The New BI&#8221;<br /> <a href="https://www.anaplan.com/hub/" target="_blank" rel="noopener">Anaplan HUB</a>: March 5-7, 2018, as an Exhibitor<br /> <a href="http://www.biwasummit.org/" target="_blank" rel="noopener">Analytics and Data Summit</a>: March 20-22, 2018, presenting &#8220;Oracle &amp; R &#8211; Advanced Analytics on Steroids&#8221;<br /> <a href="http://kscope18.odtug.com/" target="_blank" rel="noopener">Kscope 2018</a>: June 10-14, 2018, as a Bronze Sponsor (and hopefully presenting!&#8230;TBD)</p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1903 Tue Jan 16 2018 12:05:37 GMT-0500 (EST) Martin D'Souza's Farewell http://www.odtug.com/p/bl/et/blogaid=758&source=1 Martin D'Souza has served the ODTUG community as a board director for six consecutive years, from 2012 to 2017. During this time, Martin has served on the Executive Committee, the Marketing Committee, and as an APEX Community Liaison. ODTUG http://www.odtug.com/p/bl/et/blogaid=758&source=1 Tue Jan 09 2018 16:04:43 GMT-0500 (EST) Martin D'Souza's Farewell https://www.odtug.com/p/bl/et/blogaid=758&source=1 Martin D'Souza has served the ODTUG community as a board director for six consecutive years, from 2012 to 2017. During this time, Martin has served on the Executive Committee, the Marketing Committee, and as an APEX Community Liaison. ODTUG https://www.odtug.com/p/bl/et/blogaid=758&source=1 Tue Jan 09 2018 16:04:43 GMT-0500 (EST) PBCS and EPBCS Updates (January 2018): Improving Cube Performance, Removal of Support, Fixed Defects & More https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2018-january-updates <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2018-january-updates" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/pbcs%20and%20epbcs%20january%202018%20updates.jpg?t=1519157959954" alt="pbcs and epbcs january 2018 updates" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The January updates for Oracle's<span>&nbsp;</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">Planning &amp; Budgeting Cloud Service (PBCS) and Enterprise Planning and Budgeting Cloud Service (EPBCS)</a><span>&nbsp;are here.&nbsp;</span>This blog post outlines several new features for both applications, enhancements, removal of support, and fixed defects.</p> <p><em>The monthly update for PBCS and EPBCS will occur on Friday, January 19 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fpbcs-and-epbcs-2018-january-updates&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2018-january-updates Tue Jan 09 2018 15:18:04 GMT-0500 (EST) FCCS Updates (January 2018): Validating Metadata, Re-consolidating Data After Upgrading, and More https://www.us-analytics.com/hyperionblog/fccs-updates-december-2017-0 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/fccs-updates-december-2017-0" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/fccs%20january%202018%20update.jpg?t=1519157959954" alt="fccs january 2018 update" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The latest updates for&nbsp;<a href="https://www.us-analytics.com/hyperionblog/faq-oracle-financial-consolidation-and-close-cloud-service-fccs">Oracle's<span>&nbsp;Financial Consolidation and Close Cloud Service</span>&nbsp;(FCCS)</a><span> are here</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">.</a><span>&nbsp;</span>This blog post outlines multiple new features, fixed defects, and considerations.</p> <p><em>The monthly update for FCCS will occur on Friday, January 19 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ffccs-updates-december-2017-0&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/fccs-updates-december-2017-0 Tue Jan 09 2018 14:31:12 GMT-0500 (EST) I Hate Wayne Van Sluys’ Beard https://realtrigeek.com/2018/01/09/i-hate-wayne-van-sluys-beard/ <p>Okay, I don&#8217;t really hate Wayne&#8217;s beard, but I hate what it stood for when we were on a project together 4 years ago. Before I go into why, let me give you the background on my history with Wayne and Cindy.</p> <p>I was thinking last night about when I met Wayne. I honestly could not remember ever &#8220;meeting&#8221; him. It&#8217;s like he has always been in my life in some way or form for the past 5-ish years. I don&#8217;t know if it was through <a href="http://www.odtug.com">ODTUG</a>, <a href="http://www.kscope18.com" target="_blank" rel="noopener">Kscope</a>, the <a href="http://www.oracle.com/technetwork/community/oracle-ace/index.html" target="_blank" rel="noopener">Oracle ACE Program</a>, <a href="http://www.oracle.com" target="_blank" rel="noopener">Oracle</a>, or &#8230;what. I just know that when we were on a project together in Minneapolis (IN THE DEAD OF WINTER) 4 years ago, I already knew him. Being on the project together, seeing him get his ACE status during that time, working together for Kscope items, and working for the same company allows you to get to know someone. During dinners, sitting at the airport, and other times together, he always talked of his wife, Cindy. She was the joy of his life and he loved talking about her. One thing he talked about was Cindy having cancer and that was growing out his beard until she was declared in remission. To me, it was a physical reminder of his internal pain. I hated that he had that beard.</p> <p>I rolled off that project in March and didn&#8217;t see him again until June at Kscope. Almost immediately, I noticed that he was cleanly shaven. I gave him a sideways look and asked, &#8220;Your beard?!&#8221; And a proud joy came across his face when he yelled, &#8220;YES! It&#8217;s gone!&#8221; A big hug soon followed. I reveled in the joy I got to share with him that afternoon.</p> <p>Thanks to Facebook, I got to connect with Cindy soon after this and have fun with her and Wayne virtually. I thought often about how I wished we lived closer as I really enjoyed her and Wayne. That fall at Oracle OpenWorld I got the opportunity to see Wayne again and called him my date that night with Cindy&#8217;s permission. She joyfully gave it and we got a great picture to share with her (notice his beard is back, but for no particular reason this time).</p> <p><img data-attachment-id="1899" data-permalink="https://realtrigeek.com/2018/01/09/i-hate-wayne-van-sluys-beard/12049544_371483036355711_3162998503460150484_n/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=840" data-orig-size="960,540" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="12049544_371483036355711_3162998503460150484_n" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=840?w=840" class="alignnone size-full wp-image-1899" src="https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=840" alt="12049544_371483036355711_3162998503460150484_n" srcset="https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/12049544_371483036355711_3162998503460150484_n.jpg 960w" sizes="(max-width: 840px) 100vw, 840px" /></p> <p>The following summer, Kscope was held in Chicago and I found out that Cindy would be joining. I was thrilled to finally meet her in person! We got a group together for dinner post-Kscope to meet and unwind after the conference. She was even lovelier in person than virtually. I kept thinking that she has an amazing energy that was pure joy and happiness. I again lamented that we did not live close to each other.</p> <p><img data-attachment-id="1900" data-permalink="https://realtrigeek.com/2018/01/09/i-hate-wayne-van-sluys-beard/13584761_1733500970235526_4385311431218618886_o/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=840" data-orig-size="1538,2048" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="13584761_1733500970235526_4385311431218618886_o" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=840?w=225" data-large-file="https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=840?w=769" class="alignnone size-full wp-image-1900" src="https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=840" alt="13584761_1733500970235526_4385311431218618886_o.jpg" srcset="https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=113 113w, https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=225 225w, https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/13584761_1733500970235526_4385311431218618886_o.jpg 1538w" sizes="(max-width: 840px) 100vw, 840px" /></p> <p>Last year I got the news that Cindy&#8217;s cancer had returned. I was heartbroken and immediately asked God why and for healing. I had gotten to know her even more via social media and was always enjoying her posts traveling for historical reenactments, finding antiques, and loving on her son, Clark, and Wayne. I was able to get together with Cindy, Wayne, Mike Riley, and his wife, Lisa, in October while visiting for an Oracle conference presentation. As usual, there was lots of laughing and wishing we all lived closer. This was the first time I have seen Cindy in person while she was going through cancer treatment and one thing clearly stood out to me &#8211; this woman can find joy in anything. When talking about things going on with treatment, she nearly always had a smile and always found something positive. This really hit home because if she can find joy in cancer treatments, I can find joy in life&#8217;s easier curveballs.</p> <p><img data-attachment-id="1901" data-permalink="https://realtrigeek.com/2018/01/09/i-hate-wayne-van-sluys-beard/22467445_10210268757506690_925042804504228525_o/" data-orig-file="https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=840" data-orig-size="1440,1080" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="22467445_10210268757506690_925042804504228525_o" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=840?w=840" class="alignnone size-full wp-image-1901" src="https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=840" alt="22467445_10210268757506690_925042804504228525_o" srcset="https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=840 840w, https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=300 300w, https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=768 768w, https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg?w=1024 1024w, https://epmqueen.files.wordpress.com/2018/01/22467445_10210268757506690_925042804504228525_o.jpg 1440w" sizes="(max-width: 840px) 100vw, 840px" /></p> <p>My heart is heavy knowing Cindy is in pain and time is short with her. But she will live on for many, many years. My heart is heavy knowing Wayne and Clark&#8217;s bright light is going through a dim period.</p> <p>Cindy, I pray that I can learn to find joy in things the same way you do. You&#8217;ve made me smile and laugh more than Facebook can let me &#8220;like&#8221;. Your love for your husband, Clark, family, and life is radiant. You are loved. I&#8217;ve decided to dedicate my racing season to you. Your name will be marked on my body each race. My race season&#8217;s mantra is &#8220;Be the Storm&#8221;. I know with you as my lightning that I will be the storm I strive to be in my races. I can&#8217;t wait to see what we do together this year!</p> <hr /> <p>GoFundMe for the Van Sluys&#8217;: <a href="https://www.gofundme.com/vansluys" target="_blank" rel="noopener">https://www.gofundme.com/vansluys</a></p> <p>Justin Biard&#8217;s Ode to His Friend Wayne: <a href="https://icodealot.com/my-friend/" target="_blank" rel="noopener">https://icodealot.com/my-friend/ </a></p> <p>Mike Riley&#8217;s Thoughts: <a href="https://realtrigeek.com/2018/01/04/its-time-to-rally-the-oracle-community-for-the-van-sluyss/" target="_blank" rel="noopener">https://realtrigeek.com/2018/01/04/its-time-to-rally-the-oracle-community-for-the-van-sluyss/ </a></p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1898 Tue Jan 09 2018 13:47:51 GMT-0500 (EST) ARCS Updates (January 2018): Transaction Matching Balance Report, Considerations for EPM Automate, Academy, and More https://www.us-analytics.com/hyperionblog/arcs-product-update-december-2017-1 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/arcs-product-update-december-2017-1" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/arcs%20january%202018%20update.jpg?t=1519157959954" alt="arcs january 2018 update" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The first updates of the new year for Oracle's&nbsp;<a href="https://www.us-analytics.com/hyperionblog/faq-account-reconciliation-cloud-service-arcs">Account Reconciliation Cloud Service (ARCS</a>) have arrived. In this blog post, we’ll outline new guidelines for on-prem to cloud migration, fixed defects, and considerations.</p> <p>We’ll let you know any time there are updates to ARCS or any other Oracle EPM cloud products. Check the&nbsp;<a href="https://www.us-analytics.com/hyperionblog">US-Analytics Oracle EPM &amp; BI Blog</a><span>&nbsp;</span>every month.</p> <p><em>The monthly update for Oracle ARCS will occur on Friday, January 19 during your normal daily maintenance window.</em></p> <h3 style="text-align: center;"></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Farcs-product-update-december-2017-1&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/arcs-product-update-december-2017-1 Tue Jan 09 2018 13:01:22 GMT-0500 (EST) EPRCS Updates (January 2018): Relocating EPM Cloud Environments, Working with Management Reporting, Report Packages, and More https://www.us-analytics.com/hyperionblog/eprcs-updates-january-2018 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/eprcs-updates-january-2018" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/eprcs%20january%202018%20update.jpg?t=1519157959954" alt="eprcs january 2018 update" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The first EPM Cloud updates of 2018 have arrived! In this blog, we'll cover the the latest features from&nbsp;<a href="https://www.us-analytics.com/hyperionblog/enterprise-performance-reporting-cloud">Oracle Enterprise Performance Reporting Cloud Service (EPRCS)</a><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">.</a></p> <p><em>The monthly update for EPRCS will occur on Friday, January 19 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Feprcs-updates-january-2018&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/eprcs-updates-january-2018 Tue Jan 09 2018 11:49:20 GMT-0500 (EST) A Jump to the Cloud https://blog.redpillanalytics.com/a-jump-to-the-cloud-b53ada269134?source=rss----abcc62a8d63e---4 <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*h0DDQBViNcLCgJM1CmThvw.jpeg" /></figure><p>Written by: <a href="https://medium.com/u/2e09293ed18c">Phil Goerdt</a> and <a href="https://medium.com/u/e85a08406be2">Mike Fuller</a></p><p>Several years ago, I was working on an enterprise reporting project at a Fortune 15 company at about the same time that cloud-based services were really starting to catch on. During one of our meetings, a colleague of mine on the client side asked me to “explain what the cloud is”. It was a fair question on her part, and I’m confident she wasn’t the only one in the room wondering; they had invested a lot of time and money in on-premise technology and hadn’t yet entertained the idea of utilizing the cloud. I gave her my best attempt at defining the term: remotely managed applications, hardware, compute and storage. For having little experience with that flavor of tech, she seemed satisfied with my answer. This definition does concisely capture what the cloud is about, albeit rudimentary.</p><p>This particular organization has since made the move to the cloud, at least in-part, and they aren’t the only ones. Especially in the world of data and analytics, “Cloud” is ubiquitous with terms and buzzwords describing cloud services showing up everywhere: SaaS, PaaS, IaaS, DWaaS, and any other acronym describing an as-a-service offering. Even Serverless Computing is now a thing.</p><p>Cutting through all the terms and buzzwords, it’s easy to see that there are many advantages that come with leveraging cloud services. Offloading the administrative tasks, pay-as-you-go pricing models, and simplifying your technology ecosystem are a few quick wins we can achieve with the cloud.</p><p>A significant reason we have found hosted services to be advantageous is that our clients typically don’t like paying for analytics consultants to spend hours and hours installing and configuring software. This has traditionally been the case, with long project timelines to conduct installations, configurations, patching, and other set-up tasks. Additionally, these on-premises systems typically require on-going maintenance to stay up-to-date (not to mention up-and-running) but cloud means most maintenance tasks can become someone or something else’s responsibility, right? So is the cloud all it is ‘chalked up’ to be? Can we really free up developer and admin time by moving to the cloud, or is it a classic case of sales &gt; delivery?</p><p>Red Pill Analytics recently partnered with a client that chose to use cloud applications for their <em>entire BI stack</em>. They went with <a href="https://www.fivetran.com/">Fivetran</a> as the data replication utility, a cloud-based product that replicates data from source applications into a data warehouse. <a href="https://www.snowflake.net/">Snowflake Data Warehouse</a>, built exclusively for the cloud, was selected for their target data warehouse. And last but not least, <a href="https://looker.com/">Looker</a> as the data modeling and front-end reporting tool. Looker offers cloud or on-premise options; our client chose the cloud offering to round out an all-cloud BI stack.[Full disclosure: Only light-weight transformations were required for this particular use case so we were able to use a combination of database views and derived tables to satisfy the requirements. We have implemented several solutions like this and have found they are generally acceptable. For a more robust solution, an intensive transformation layer most likely requires an additional piece of technology not mentioned here.]</p><p>Given that all three products mentioned are hosted services, there were zero installation tasks and minimal configuration. We landed on site and started loading data the same day the project kicked off. After a few days, we had a good start on the data model and we were creating reports and dashboards by the end of the week. This quick win helped us illustrate tremendous value to the business instead of spending weeks or months provisioning servers, installing software, etc., etc. Back to the question at hand, we typically find with that cloud-based products allow projects to get off the ground faster and limit up-front costs for our clients. In our minds, this is how most analytics and data projects should be.</p><p>We liked the idea of leveraging the cloud for analytics so much that Red Pill has teamed up with Fivetran, Snowflake, and Looker to bring you an immersion course on how to do this for yourself. We call it the Jump Program: one eight-hour day of learning and building, from database to dashboard. We think it is a pretty great idea, but perhaps the greatest thing is that it is <strong><em>free</em></strong> to attend. No hidden fees. No secret cover charges. No drink minimum. No presentations for timeshares. Just a group of people willing to share what they know about what is possible with the next wave of analytics. Kevin and Stewart will be there. Representatives from the vendors will be there. So, what are you waiting for? <a href="http://jumpprogram.eventzilla.net/web/event?eventid=2138924693">Register here for the Jump Program on January 11th, 2018.</a></p><p>I guess there is such a thing as a free lunch, after all.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b53ada269134" width="1" height="1"><hr><p><a href="https://blog.redpillanalytics.com/a-jump-to-the-cloud-b53ada269134">A Jump to the Cloud</a> was originally published in <a href="https://blog.redpillanalytics.com">Red Pill Analytics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p> Mike Fuller https://medium.com/p/b53ada269134 Sat Jan 06 2018 09:20:15 GMT-0500 (EST) It’s Time to Rally the Oracle Community for the Van Sluys’s! https://realtrigeek.com/2018/01/04/its-time-to-rally-the-oracle-community-for-the-van-sluyss/ <p>Thanks to <a href="https://twitter.com/Mike_ODTUG" target="_blank" rel="noopener">Mike Riley</a> for the following post for the <a href="https://www.gofundme.com/vansluys">GoFundMe</a> page for <a href="https://twitter.com/wvansluys">Wayne Van Sluys</a> and his family.<a href="https://twitter.com/wvansluys"></a></p> <p style="font-weight:400;">Cancer Sucks! I know, I&#8217;ve been there. And many of you were there for me and my family. Starting with my friend Chet Justice, the community rallied around us, and did countless good things for us. I was blessed to survive (just celebrated 4 years post surgery and in remission). Sending us to a World Series game to take our minds off of cancer for a night, helping us pay bills, sending us cards, feeding us (thanks Kellyn and Tim!), sending us care packages, etc&#8230;It was amazing the way the community rallied, and amazing the support and love we felt.</p> <p style="font-weight:400;">Fast forward to today, and I feel it is time to send out a cry for help again, this time for a dear friend. Many of you know Wayne Van Sluys from ODTUG and KScope. Wayne is about the nicest guy I know. It breaks my heart to know that Wayne&#8217;s wife Cynthia has been battling cancer for the past couple of years. Shortly before Christmas, they received the devastating news that Cynthia&#8217;s cancer had spread and that chemotherapy or surgery would not be advisable. Cynthia has been sent home and is under hospice care now. Cynthia and Wayne have been married for many years now, and they have a son Clark who requires 24 hour care. They are a proud, happy, and loving family, and they need our help.</p> <p style="font-weight:400;">How can you help? If you know the family, reach out to them, send them a note, anything. I speak from experience unfortunately in that even the smallest gestures will mean a great deal to them. Don&#8217;t ask them what you can do for them. If you think of something, DO IT! Trust me, they won&#8217;t say no. Anything will help them, and will make you feel like you are making a difference (because you are).</p> <p style="font-weight:400;">Additionally, there is one more thing for you to do. If you can afford any amount at all (no donation is too small or too large), we (a group of Wayne and Cynthia&#8217;s friends) have set up a GoFundMe account for them. From the page &#8220;The funds raised by this campaign will help pay for: outstanding medical bills, memorial expenses, and continued care for Cindy. Remaining funds will be used to help pay for Clark to go to summer camp (<a href="http://www.wonderlandcamp.org%29/">www.wonderlandcamp.org)</a>&#8220;.</p> <p style="font-weight:400;"> The address is: <a href="https://www.gofundme.com/vansluys">https://www.gofundme.com/vansluys</a></p> <p>Please consider helping these folks out. Show them how a community always rallies to support one another. You&#8217;ve done it before. Let&#8217;s do it again. Thanks for reading!</p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1895 Thu Jan 04 2018 08:23:34 GMT-0500 (EST) Relation Theory videos by CJ Date http://www.oralytics.com/2018/01/relation-theory-videos-by-cj-date.html <p->Here is a series of videos by CJ Date on Relational Theory.</p> <p>Introduction video</p><iframe width="500" height="340" src="https://www.youtube.com/embed/cnbbMQaTGP0" frameborder="0" gesture="media" allow="encrypted-media" allowfullscreen></iframe> <p>An Introduction to set theory (videos on O'Reilly website)</p><a href="https://player.oreilly.com/videos/9781491908778"><img src="https://lh3.googleusercontent.com/-db_Zj4db5pI/Wk4FDyq0v4I/AAAAAAAAMSA/NiVRbSS2IYo7VfwaYQv5fDUX59hLnwvxgCHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="489" height="340" /></a> <p>Nullology (videos on O'Reilly website)</p><a href="https://player.oreilly.com/videos/9781491908815"><img src="https://lh3.googleusercontent.com/-J7zQ4klr4bI/Wk4FVETZ2gI/AAAAAAAAMSE/KP-tZ1N8QOARW40dbGQxZTs-lTcVi1MFACHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="489" height="340" /></a> <p>Nulls, Three-Valued Logic, and Missing Information (videos on O'Reilly website)</p><a href="https://player.oreilly.com/videos/9781491908839"><img src="https://lh3.googleusercontent.com/-NUjSlxJAeEQ/Wk4FlTUtKGI/AAAAAAAAMSM/r1zZiBioyTUZOY5prI4ywSSr9v0VjVD4gCHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="489" height="340" /></a> <p>The Closed World Assumption (videos on O'Reilly website)</p><a href="https://player.oreilly.com/videos/9781491908853"><img src="https://lh3.googleusercontent.com/-HSRLZN5Lmns/Wk4F2QQ8EuI/AAAAAAAAMSQ/4Q01uX1tyfkr2vIYrdlLAMiHMoevNwL_ACHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="489" height="340" /></a> <p>View Updating (videos on O'Reilly website)</p><a href="https://player.oreilly.com/videos/9781491908792"><img src="https://lh3.googleusercontent.com/-TIl9eI8K0IY/Wk4GDPgA_RI/AAAAAAAAMSU/xxhpkt50XEkMq9VLoIRHN9h3H9-sUeu9ACHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="489" height="340" /></a> Brendan Tierney tag:blogger.com,1999:blog-4669933501315263808.post-8004686860308354391 Thu Jan 04 2018 05:47:00 GMT-0500 (EST) EPM Consulting: How to Save Time, Energy & Money https://www.us-analytics.com/hyperionblog/epm-consulting-save-time-energy-and-money <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/epm-consulting-save-time-energy-and-money" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/save%20time%20and%20money%20with%20epm%20consulting.jpg?t=1519157959954" alt="save time and money with epm consulting.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span style="background-color: transparent;">Before getting started, you know your EPM project will be costly, take time, and tie up valuable resources. However, whether you’re upgrading, implementing a new solution, or moving to the cloud, there are steps you can take to ensure your projects are successful and money is well spent.</span></p> <p>Your EPM tools are an important investment that will help optimize your processes and improve data consistency. The following tips will help you get the most out of that investment and ensure that you’re fully using your EPM tools.</p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fepm-consulting-save-time-energy-and-money&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Wayne Conrad https://www.us-analytics.com/hyperionblog/epm-consulting-save-time-energy-and-money Wed Jan 03 2018 16:26:00 GMT-0500 (EST) My Very First “Data Warehouse” https://danischnider.wordpress.com/2018/01/03/my-very-first-data-warehouse/ <p>Turn of the year is always a good time to look back in history. In this first blog post of the new year, I want to tell you the story of my very first “data warehouse” project. A not very serious blog post with some serious recommendations in the end.</p> <p><span id="more-542"></span></p> <p>Yesterday, the public Swiss radio station celebrated the 50th anniversary of the Swiss charts (“Schweizer Hitparade”). The whole day, they played number one hits of the last five decades. When I listened to some of the songs of the late seventies and early eighties, that reminded me of my first software development project.</p> <p>As a teenager, the weekly charts in the radio were an important regular event for me. I did not only listen to all the new songs, but wrote down the chart classifications of the top 15 songs every week &#8211; very old-fashioned with paper and pencil. I spent hours with statistical evaluations: Which band had the most songs in the charts? Which songs were in the top 3, 10 or 15 ranks for how many weeks? How was the distribution between English, German and Swiss German songs? As you can see, a lot of really important and useful information for a teenager like me.</p> <p>In 1981, I bought my first computer: a <a href="http://www.computinghistory.org.uk/det/1774/Commodore-PET-3032/">Commodore PET 3032</a> with the gigantic memory capacity of 32 kilobytes! Because I spent so much time with this machine, I could never part with it. My old Commodore computer is still in our cellar, but I guess it does not run anymore.</p> <p><img title="commodore.jpg" src="https://danischnider.files.wordpress.com/2018/01/icommodore.jpg?w=150&#038;h=150" alt="Commodore" width="150" height="150" border="0" /> <img title="dani_1979.jpg" src="https://danischnider.files.wordpress.com/2018/01/idani_1979.jpg?w=150&#038;h=150" alt="Dani 1979" width="150" height="150" border="0" /><br /><em>The old hardware… and the young programmer</em></p> <p>My first software project was a kind of “data warehouse” (of course, I did not know this term in 1981 &#8211; it was first introduced in 1988). I spent several weeks in developing a BASIC program to insert and edit the Swiss chart rankings. The data was stored in a BASIC array in memory. So, I already worked with “in-memory databases” in the early eighties. But I was aware that data must be stored in a “non-volatile” form and even implemented a “Save” function that stored the whole data to an audio cassette.</p> <p>The user interface was quite comfortable: After starting the program, the history data had to be read from cassette (this took several minutes). Then I was able to insert the results of the next chart edition. Songs that already were in the top 15 of the previous week had not be inserted again. I just had to type in the rank of the last edition, and the program copied (not referenced!) the title and singer/band name automatically. Wow! A kind of “slowly changing charts”&#8230;</p> <p>When the radio show was over and I entered all my new data, I had to rewind the tape of the audio cassette and press the shortcut command “S” to save the data (for young readers of my blog: the Commodore computer had neither a mouse nor a trackpad nor a touch screen &#8211; just a keyboard).</p> <p>The BASIC program contained several statistic functions, for example, an overall ranking for the current year, and some more stuff. I even implemented security functionality. Two passwords were required, one to edit and one to read the data (I can’t remember this detail, but I think the passwords were hard-coded in the program code).</p> <p>After a short test phase with a small data set, my program was ready to use. I started to type in the chart rankings of 1979 (that was when I started to track the classifications). The papers I used for this were a kind of a “staging area” for my new program. After I inserted the data for the first few weeks, my Commodore displayed an error message I haven’t seen before: <em>OUT OF MEMORY ERROR.</em></p> <p>Oh no!!!</p> <p>What happened? What I did not realize is that most of the 32K memory was already occupied by the BASIC program I wrote &#8211; presumably hundreds of lines of “spaghetti code” with many GOTO commands. My nice concept of loading the whole history from cassette to memory was not very clever. The software project died before it was “in production”. Fortunately, that never happens in real projects nowadays &#8211; or does it?</p> <h1>Lessons Learned</h1> <p>Of course, this experience was quite disappointing for me. But at least, I learned three important things:</p> <ol> <li>No matter how much memory your hardware has &#8211; it’s always too little.</li> <li>Software tests should always be done with a realistic amount of data, not only with small test sets.</li> <li>A software should contain the functions that are required, not everything that is  technically possible.</li> </ol> <p>Although technology has evolved since then, these three rules are still in place &#8211; but disregarded in many projects. Perhaps I’m wrong, but could it be that my little software project was not the only one that failed because of these rules?</p> Dani Schnider http://danischnider.wordpress.com/?p=542 Wed Jan 03 2018 11:27:37 GMT-0500 (EST) How Do I Increase BI User Adoption? 5 Ways to Ensure Successful BI Training https://www.us-analytics.com/hyperionblog/how-to-increase-bi-user-adoption <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/how-to-increase-bi-user-adoption" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/how%20to%20increase%20bi%20user%20adoption.jpg?t=1519157959954" alt="How Do I Increase BI User Adoption? 5 Ways to Ensure Successful BI Training" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>So, you have this great business intelligence tool that came with many promises. The promise to give you valuable insight to grow your organization. The promise to ease and automate your processes. The promise to improve visibility into your operations. The list goes on. But none of that means anything without user adoption.</p> <p>People get set in their ways and tend to dislike change — making user adoption a tricky situation. The solution to this problem is training, but it’s not as simple as it sounds. There are several steps you must take to ensure your BI training is effective and enacts user adoption throughout your organization.</p> <p>In this blog post, we’ll talk about how you can ensure successful training that will, in turn, increase user adoption.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fhow-to-increase-bi-user-adoption&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Daniel Delgado https://www.us-analytics.com/hyperionblog/how-to-increase-bi-user-adoption Tue Jan 02 2018 12:14:00 GMT-0500 (EST) OBIA 11.1.1.10.2 New Features: ETL Error Handling & Email Notifications https://www.us-analytics.com/hyperionblog/oracle-bi-apps-etl-error-handling <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/oracle-bi-apps-etl-error-handling" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/OBIA%20tutorial%20etl%20error%20handling.jpg?t=1519157959954" alt="OBIA 11.1.1.10.2 New Features: ETL Error Handling &amp; Email Notifications" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The latest version of OBIA — 11.1.1.10.2 — came with a variety of new features. In this blog post, I will show you how Error Handling is managed, how it now works within many of the knowledge modules, what the report html files look like, and how to set up the email process.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Foracle-bi-apps-etl-error-handling&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Becky Wagner https://www.us-analytics.com/hyperionblog/oracle-bi-apps-etl-error-handling Mon Jan 01 2018 10:46:00 GMT-0500 (EST) Incremental Statistics – A Real World Scenario https://danischnider.wordpress.com/2017/12/30/incremental-statistics-a-real-world-scenario/ <p>Incremental statistics reduce the time to gather global statistics for a partitioned table. Really? In some situations it may happen that incremental statistics slow down statistics calculation dramatically. An example of a real project in Oracle 12.1 and how it can be improved with Oracle 12.2.</p> <p><span id="more-537"></span></p> <p>Gathering global statistics of a partitioned table is time-consuming. Normally, all partitions of a (large) partitioned table must be scanned to calculate the statistics on table level. To reduce this time, incremental statistics were introduced with Oracle 11g. If this feature is enabled, additional statistics information is gathered for each partition and stored as “synopsis”. To (re-)calculate the global statistics, only the synopses must be read instead of the whole table. A good description of this concept can be found in the blog post <a href="https://blogs.oracle.com/optimizer/efficient-statistics-maintenance-for-partitioned-tables-using-incremental-statistics-part-1">Efficient Statistics Maintenance for Partitioned Tables Using Incremental Statistics &#8211; Part 1</a> of Nigel Bayliss. </p> <p>Incremental statistics are especially useful for environments where only a few partitions are changed at a time, but many partitions exist per table. This is usually the case in data warehouses where new data is loaded into a current partition. When the statistics on partition-level are gathered for the current partition, the global statistics are updated using the synopsis information of all the historical partitions and the current partition.</p> <p>In a large data warehouse at one of my customers, we decided to introduce incremental statistics. Most of the tables are INTERVAL partitioned by date, containing daily partitions. We enabled interval partitioning for all of the 891 partitioned tables and started the DBMS_STATS.GATHER_SCHEMA_STATS procedure. The job was running for two weeks(!). While it was quite efficient at the beginning, it became slower and slower with every table. Finally, when all partition-level and global statistics were up-to-date, I thought the time-consuming part is over now. The initial effort was quite high, but now we are able to benefit from the synopses that were calculated during this long time.</p> <p>This was a wrong assumption: Whenever we started a job to gather statistics for an individual partition (even if the partition contained only a small number of rows), it took around 40 minutes to calculate the synopsis information for this partition. What was going on here? For this, let&#8217;s have to look under the hood of DBMS_STATS.</p> <h1>A Look Under the Hood of DBMS_STATS</h1> <p><img title="synopsis_tables.jpg" src="https://danischnider.files.wordpress.com/2017/12/isynopsis_tables.jpg?w=163&#038;h=174" alt="Synopsis tables" width="163" height="174" border="0" /></p> <p>The synopsis information used for incremental statistics is stored in the SYSAUX tablespace in the two tables SYS.WRI$_OPTSTAT_SYNOPSIS_HEAD$ and SYS.WRI$_OPTSTAT_SYNOPSIS$. Since Oracle 12.1, the detail table WRI$_OPTSTAT_SYNOPSIS$ is partitioned using composite LIST-HASH partitioning.</p> <p>On the customer database (Oracle Database 12.1.0.2 Enterprise Edition, around 24 TB of data), the head table WRI$_OPTSTAT_SYNOPSIS_HEAD$ contains about 13 million rows, the detail table WRI$_OPTSTAT_SYNOPSIS$ about 10 billion rows. The two tables together use about 320 GB of disk space in the SYSAUX tablespace. The reason for this high amount of synopsis data is the number of partitions in this database. All 891 partitioned tables together contained 325851 partitions. This was the state at end of November, about one month ago. Because new partitions are created every day for most of the tables, there will be a few thousand more now.</p> <p>On the list of long-running SQL statements, the following query was always one of the most time-consuming statements. It seems that the query is executed very often (for each table or even each partition?) as part of the incremental statistics calculation. On a “normal” database, this is not critical, but on the 13 million rows of the synopsis table, each execution was running for several minutes. As far as I could see (without knowing the internal code of the DBMS_STATS package), this seems to be the “bad guy” that wasted most of the time.</p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"> </p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">SELECT DISTINCT BO#, GROUP#</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">  FROM SYS.WRI$_OPTSTAT_SYNOPSIS_HEAD$ H</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;"> WHERE GROUP#   &lt;&gt; 0</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">   AND GROUP# NOT IN</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">       (SELECT T.OBJ# * 2 FROM SYS.TABPART$ T</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">       UNION ALL</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">       SELECT T.OBJ# * 2 FROM SYS.TABCOMPART$ T</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;">       )</span></p> <p style="margin:0;font-size:10px;line-height:normal;font-family:Monaco;color:#fff900;background-color:#6c6c6c;"><span style="font-variant-ligatures:no-common-ligatures;"> </span></p> <p>It would be possible to rewrite this SQL statement to run faster, but of course this was not an option. I’m not able nor allowed to change the internal queries of DBMS_STATS. But at least I found out that this statement is executed only on Oracle 12.1. I did some tests on my laptop with incremental statistics on Oracle version 11.2, 12.1 and 12.2. Only in the trace file of Oracle 12.1 I found this statement.</p> <h1>Searching for a Solution</h1> <p>While looking around for a solution or a workaround, I found several notes on <a href="https://support.oracle.com/">My Oracle Support</a> (MOS), for example the document <a href="https://support.oracle.com/epmos/faces/DocumentDisplay?id=2041541.1">Gather_Database_Stats_Job_Proc Taking More Time in 12.1.0.2 Than 11.2.0.4</a> (Doc ID 2041541.1). But the more documents I browsed, the more I got the impression that there are many bugs on 12.1.0.2 with incremental statistics.</p> <p>In the blog post <a href="https://mikedietrichde.com/2016/04/28/incremental-statistics-collection-in-oracle-12-1-0-2-a-true-story/">Incremental Statistics Collection in Oracle 12.1.0.2 – A True Story</a> of Mike Dietrich, I read that there are really several issues with incremental statistics in Oracle 12.1.0.2, but there are multiple patches and bug fixes available. Unfortunately, the referenced MOS document <a href="https://support.oracle.com/epmos/faces/DocumentDisplay?id=2107602.1">Things to Consider When Using Incremental Statistics</a> (Doc ID 2107602.1) is rather confusing, and some of the patches mentioned in the document exclude each other.</p> <p>Finally, we decided to solve the performance problem with a simple, but effective solution: We turned off incremental statistics, as I also mentioned on <a href="https://twitter.com/dani_schnider/status/935457784124100608">Twitter</a>.</p> <p><a href="https://twitter.com/dani_schnider/status/935457784124100608"><img title="twitter.jpg" src="https://danischnider.files.wordpress.com/2017/12/itwitter.jpg?w=297&#038;h=143" alt="Twitter" width="297" height="143" border="0" /></a></p> <p>Instead of gathering incremental statistics after each load job, a statistics job will run now every Sunday. It gathers the partition-level statistics of all stale partitions and global statistics of tables, if required. Interestingly, this job runs much faster than the previous job with incremental statistics &#8211; although all partitions must be scanned now to gather the global statistics.</p> <p>I’m not very happy with this (temporary) workaround. I still hope to find a better and more elegant way to gather global statistics on partitioned tables. Probably, Oracle 12.2 will solve our problem?</p> <h1>A Better Solution in Oracle 12.2?</h1> <p>A few days after this story, I had the chance to meet Nigel Bayliss, product manager of the Oracle optimizer, at the <a href="https://danischnider.wordpress.com/2017/12/10/ukoug-tech17-chocolate-and-knowhow-sharing/">UKOUG Tech17</a> conference. He explained me that there is a new way to calculate the synopsis values in Oracle 12c Release 2. Instead of storing a lot of detail data in table WRI$_OPTSTAT_SYNOPSIS$ to retrieve the number of distinct values for each column, a HyperLogLog algorithm is used to calculate an approximate number of distinct values. If only this new algorithm is used, the (large) synopsis detail table will not be used anymore. It is still in place for backward compatibility. With the new DBMS_STATS preference APPROXIMATE_NDV_ALGORITHM, the method to calculate synopses can be defined. The default REPEAT OR HYPERLOGLOG uses the old method for existing tables, but the HyperLogLog algorithm for all new tables. If the preference is switched to HYPERLOGLOG, much less synopsis data is stored in the SYSAUX tablespace. An overview of this new way to calculate synopses for incremental statistics he described in his blog post <a href="https://blogs.oracle.com/optimizer/efficient-statistics-maintenance-for-partitioned-tables-using-incremental-statistics-part-3">Efficient Statistics Maintenance for Partitioned Tables Using Incremental Statistics – Part 3</a>. Additionally, a set of demo scripts is available on <a href="https://github.com/oracle/oracle-db-examples/tree/master/optimizer/new_synopses">GitHub</a>.</p> <p>I played around with these demo scripts and did some tests with the DBMS_STATS preference APPROXIMATE_NDV_ALGORITHM on my laptop. At least, the new method to calculate incremental statistics looks promising, and the “bad statement” described above seems to be gone. But currently I can’t say (yet) whether it will help to solve the performance issue of my customer’s database. Hopefully, my customer will decide to migrate to Oracle 12c Release 2 soon. Then I’m looking forward to enable incremental statistics again.</p> Dani Schnider http://danischnider.wordpress.com/?p=537 Fri Dec 29 2017 19:02:57 GMT-0500 (EST) 2017 – ODTUG’s Year in Review http://www.odtug.com/p/bl/et/blogaid=755&source=1 As 2018 comes to a close, we reflect on ODTUG's year. ODTUG sponsored many successful meetups, hosted lots of webinars, elected a new board of directors for 2018-2019, welcomed a new leadership class for 2018, celebrated its 20th birthday, celebrated 10 years of community service, and more! ODTUG http://www.odtug.com/p/bl/et/blogaid=755&source=1 Fri Dec 29 2017 10:14:04 GMT-0500 (EST) 2017 – ODTUG’s Year in Review https://www.odtug.com/p/bl/et/blogaid=755&source=1 As 2018 comes to a close, we reflect on ODTUG's year. ODTUG sponsored many successful meetups, hosted lots of webinars, elected a new board of directors for 2018-2019, welcomed a new leadership class for 2018, celebrated its 20th birthday, celebrated 10 years of community service, and more! ODTUG https://www.odtug.com/p/bl/et/blogaid=755&source=1 Fri Dec 29 2017 10:14:04 GMT-0500 (EST) Oracle 12c Release 2 New Feature Real-Time Refreshable Materialized Views https://gavinsoorma.com/2017/12/oracle-12c-release-2-new-feature-real-time-refreshable-materialized-views/ <p>One of the new features in Oracle 12c Release 2 is <strong>real-time refreshable Materialized Views</strong>.<br /> &nbsp;<br /> In earlier releases, even if a single row in the base table got changed, the underlying materialized view was marked as stale and this prevented any query rewrite operations until the materialized view </p><div class="mgm_private_no_access"><div style="border-style:solid; border-width:1px; margin-bottom:1em; background-color:#E4F2FD; border-color:#C6D9E9; margin:5px; font-family:'Lucida Grande','Lucida Sans Unicode',Tahoma,Verdana,sans-serif; font-size:13px; color:#333333;"> <div style="margin: 5px 10px;">You need to be logged in to see this part of the content. Please <a href="https://gavinsoorma.com/login/?redirect_to=https://gavinsoorma.com/2017/12/oracle-12c-release-2-new-feature-real-time-refreshable-materialized-views/"><b>Login</b></a> to access. </div> </div></div> Gavin Soorma https://gavinsoorma.com/?p=8081 Mon Dec 25 2017 13:06:03 GMT-0500 (EST) Happy Holidays from ODTUG! http://www.odtug.com/p/bl/et/blogaid=761&source=1 The moment you've all been waiting for... the annual ODTUG Kscope holiday jingle! Happy Holidays! ODTUG http://www.odtug.com/p/bl/et/blogaid=761&source=1 Wed Dec 20 2017 10:49:00 GMT-0500 (EST) Happy Holidays from ODTUG! https://www.odtug.com/p/bl/et/blogaid=761&source=1 The moment you've all been waiting for... the annual ODTUG Kscope holiday jingle! Happy Holidays! ODTUG https://www.odtug.com/p/bl/et/blogaid=761&source=1 Wed Dec 20 2017 10:49:00 GMT-0500 (EST) Happy Holidays from ODTUG! http://kscope18.odtug.com/p/bl/et/blogaid=761&source=1 The moment you've all been waiting for... the annual ODTUG Kscope holiday jingle! Happy Holidays! ODTUG http://kscope18.odtug.com/p/bl/et/blogaid=761&source=1 Wed Dec 20 2017 10:49:00 GMT-0500 (EST) Introducing Pixel Perfect Reporting in Oracle Analytics Cloud https://blogs.oracle.com/xmlpublisher/introducing-pixel-perfect-reporting-in-oracle-analytics-cloud <p><img alt="" src="https://cdn.app.compendium.com/uploads/user/e7c690e8-6ff9-102a-ac6d-e4aebca50425/2da1ea84-cf2c-4d06-967e-3d47de31518b/Image/62dfa223afe7cbf72e60b8adc37c041f/biponoac2.jpg" style="width: 800px; height: 362px;" /></p> <p>&nbsp;</p> <p>For all you BI Publisher fans, here is the good news -&nbsp;<strong>BI Publisher is now available with Oracle Analytics Cloud !!</strong></p> <p><strong>Oracle Analytics Cloud (OAC)</strong> is a scalable and secure public cloud service that provides a full set of capabilities to explore and perform collaborative analytics for your enterprise. You can take data from any source, explore with Data Visualization and collaborate with real-time data. It is available in three flavors - Standard Edition, Data Lake Edition and Enterprise Edition, with Standard Edition giving the base ability to explore data, Data Lake Edition allowing insights into big data, and Enterprise Edition offering the full platter of data exploration, big data analytics, dashboard, enterprise reporting, Essbase etc. Refer to <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/what-is-oracle-analytics-cloud.html#GUID-081B5BDA-87BD-4C1C-B73B-A3D80A0548AB" target="_blank">this documentation</a> for additional details on different editions.</p> <p>With <strong>OAC 17.4.5 Enterprise Edition</strong>, now you can create pixel perfect report and deliver to a variety of destinations such as&nbsp;email, printer, fax, file server using ftp or WebDAV, Webcenter Content and Content &amp; Experience Cloud. The version of BI Publisher here is 12.2.4.0.</p> <p>If you have used BI Publisher On-prem, the experience will be very similar feature wise and look-and-feel wise, and therefore you will find it easy to get on-board. If you are new to BI Publisher, you will now be able to create pixel perfect and highly formatted business documents in OAC such as Invoices, Purchase Orders, Dunning Letters, Marketing Collateral, EFT &amp; EDI documents, Financial Statements, Government Forms, Operational Reports, Management Reports, Retail Reports, Shipping Labels with barcodes, Airline boarding passes with PDF417 barcode, Market to Mobile content using QR code, Contracts with fine-print on alternate page, Cross-tab reports, etc.</p> <p>You can connect to a variety of data sources including&nbsp;BI Subject Areas, BI Analysis and RPD; Schedule your report to run once or as a recurring job; and even burst documents to render in multiple formats and be delivered to multiple destinations.</p> <p>&nbsp;</p> <p><strong>Can we move from BI Publisher on-prem to BI Publisher on OAC?</strong></p> <p>Well yes, you can. You will have to understand your on-prem deployment and plan accordingly. If your data can be migrated to OAC, that will be the best otherwise you can plan to extend your network to Oracle Cloud allowing OAC to access your on-prem data. The repository can be migrated by archiving and unarchiving mechanism. User data management will be another task where application roles from On-prem will need to be added to OAC application roles. Details on this will be coming soon.</p> <p>&nbsp;</p> <p><strong>Benefits of BI Publisher on OAC</strong></p> <p>First of all OAC comes with many great features around data exploration and visualization with advanced analytics capabilities. BI Publisher compliments this environment for pixel perfect reporting. So now you have an environment that is packed with Industry leading BI products providing an end-to-end solution for an enterprise.&nbsp;</p> <p>Managing Server instances will be a cake walk now, with just few clicks you will be able to scale up/down to a different compute shape or scale out/in to manage nodes in the cluster, saving you both time and money.</p> <p>Many self service features to manage reports and server related resources.</p> <p>&nbsp;</p> <p><strong>What&#39;s new in BI Publisher 12.2.4.0?</strong></p> <p>BI Publisher in OAC includes all features of 12.2.1.3 and has the following new features in this release:</p> Accessible PDF Support (Tagged PDF &amp; PDF/UA-1) <img alt="" src="https://cdn.app.compendium.com/uploads/user/e7c690e8-6ff9-102a-ac6d-e4aebca50425/2da1ea84-cf2c-4d06-967e-3d47de31518b/Image/c850d6e00ab42ce75d22b2cc0f3d7787/acc.jpg" style="width: 195px; height: 75px;" /> New Barcodes - QR Code and&nbsp;<span style="background-color: rgb(220, 220, 220);">PDF417</span> <img alt="" src="https://cdn.app.compendium.com/uploads/user/e7c690e8-6ff9-102a-ac6d-e4aebca50425/2da1ea84-cf2c-4d06-967e-3d47de31518b/Image/a26bfc29b03b5bc458870dbcf1693048/barcode2.jpg" style="width: 256px; height: 75px;" /> <span style="background-color: rgb(220, 220, 220);">Ability to purge Job History</span> <img alt="" src="https://cdn.app.compendium.com/uploads/user/e7c690e8-6ff9-102a-ac6d-e4aebca50425/2da1ea84-cf2c-4d06-967e-3d47de31518b/Image/47bb9722d6ef520856dff8852e32edd8/purge.jpg" style="width: 180px; height: 75px;" /> <span style="background-color: rgb(220, 220, 220);">Ability to view diagnostic log for online report</span> <img alt="" src="https://cdn.app.compendium.com/uploads/user/e7c690e8-6ff9-102a-ac6d-e4aebca50425/2da1ea84-cf2c-4d06-967e-3d47de31518b/Image/c455ccff0d3e1ab750040c3d0d377179/diagnosticlog.jpg" style="width: 137px; height: 150px;" /> Widow-orphan support for RTF template <img alt="" src="https://cdn.app.compendium.com/uploads/user/e7c690e8-6ff9-102a-ac6d-e4aebca50425/2da1ea84-cf2c-4d06-967e-3d47de31518b/Image/adbbb7e8e4e79114cb0ced80ba6d4df1/widoworphan.jpg" style="width: 189px; height: 150px;" /> <p>&nbsp;</p> <p>So why wait? You can quickly check this out by creating a free trial account <a href="https://cloud.oracle.com/en_US/oac">here</a>. Once you login, you are in OAC home page. To get to BI Publisher you need to click on the Page Menu on right side top of the page and then select option &quot;Open Classic Home&quot;. BI Publisher options are available under Published Reporting in the classic home page.</p> <p>For further details on pixel perfect reporting, check the latest <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/index.html" target="_blank">Oracle Analytics Cloud Documentation</a>.</p> <p>&nbsp;</p> <p>Stay tuned for more updates on upgrade and new features !</p> Pradeep Sharma https://blogs.oracle.com/xmlpublisher/introducing-pixel-perfect-reporting-in-oracle-analytics-cloud Wed Dec 20 2017 09:30:00 GMT-0500 (EST) ODTUG KSCOPE18 ABSTRACTS: SPECIAL CALL! http://www.odtug.com/p/bl/et/blogaid=760&source=1 We're living in exciting times, my friends. Remember the iconic novels from decades past about robots taking over the world? Well, perhaps we aren’t there yet, but we are the first to experience the power of intelligent machines on Oracle software. ODTUG http://www.odtug.com/p/bl/et/blogaid=760&source=1 Fri Dec 15 2017 16:08:50 GMT-0500 (EST) ODTUG KSCOPE18 ABSTRACTS: SPECIAL CALL! http://kscope18.odtug.com/p/bl/et/blogaid=760&source=1 We're living in exciting times, my friends. Remember the iconic novels from decades past about robots taking over the world? Well, perhaps we aren’t there yet, but we are the first to experience the power of intelligent machines on Oracle software. ODTUG http://kscope18.odtug.com/p/bl/et/blogaid=760&source=1 Fri Dec 15 2017 16:08:50 GMT-0500 (EST) What to Know Before Moving Hyperion to the Cloud https://www.us-analytics.com/hyperionblog/what-to-know-before-moving-hyperion-to-the-cloud <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/what-to-know-before-moving-hyperion-to-the-cloud" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/move%20hyperion%20to%20the%20cloud.jpg?t=1519157959954" alt="move hyperion to the cloud.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span style="background-color: transparent;">There’s a lot of information out there about moving from Oracle Hyperion to the Oracle EPM Cloud, which makes sense — there’s a lot you need to know. However, that saturation of content can be difficult to sift through and keep organized. This blog post is your solution.</span></p> <p>In it you’ll find a high-level overview of what you need to know before moving your on-prem tools to the Oracle EPM Cloud, along with links to more in-depth content. You’ll have a single point of reference to answer your questions about moving to the cloud.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fwhat-to-know-before-moving-hyperion-to-the-cloud&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/what-to-know-before-moving-hyperion-to-the-cloud Wed Dec 13 2017 18:01:08 GMT-0500 (EST) The Top 10 EPM Downloads of 2017 https://www.us-analytics.com/hyperionblog/top-epm-downloads-2017 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/top-epm-downloads-2017" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/top%2010%20epm%20downloads%202017.jpg?t=1519157959954" alt="top 10 epm downloads 2017.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>This year, we created more content than ever before to help you get the most out of your EPM investment. We looked back at all the eBooks, tools, webinars, and checklists to see what you loved most.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ftop-epm-downloads-2017&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/top-epm-downloads-2017 Tue Dec 12 2017 14:00:24 GMT-0500 (EST) The Top 5 BI Downloads of 2017 https://www.us-analytics.com/hyperionblog/top-bi-downloads-2017 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/top-bi-downloads-2017" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/top%20BI%20downloads%202017.jpg?t=1519157959954" alt="top BI downloads 2017.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span style="background-color: transparent;">At US-Analytics, we’re always looking ahead, but we also realize looking back is important for continual growth. It was a big year for us. </span><a href="https://www.us-analytics.com/hyperionblog/us-analytics-acquires-rittman-mead-america" style="background-color: transparent;">We acquired BI firm Rittman Mead America Inc.,</a><span style="background-color: transparent;"> extending our business analytics expertise and offerings.</span></p> <p>This means you can expect even more <a href="https://www.us-analytics.com/hyperionblog/topic/business-intelligence">BI resources</a> coming in 2018 — so keep an eye out. For now, you can check out our most popular downloads from 2017 to help you prepare and jumpstart a successful new year.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ftop-bi-downloads-2017&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/top-bi-downloads-2017 Tue Dec 12 2017 12:51:12 GMT-0500 (EST) Oracle Code Online December 2017 http://www.oralytics.com/2017/12/oracle-code-online-december-2017.html This week Oracle Code will be having an online event consisting of 5 tracks and with 3 presentations on each track. This online Oracle Code event will be given in 3 different geographic regions on 12th, 13th and 14th December. <img src="https://lh3.googleusercontent.com/-QN7IVkrs_EY/Wi5uoE7VQ8I/AAAAAAAAMRk/vl5VhEx3d24YMF32axWI_OYG-q8AZC8twCHMYCw/NewImage.png?imgmax=1600" alt="NewImage" title="NewImage.png" border="0" width="650" height="400" /> I've been selected to give one of these talks, and I've given this talk at some live Oracle Code events and at JavaOne back in October. The present is pre-recorded and I recorded this video back in September. I hope to be online at the end of some of these presentations to answer any questions, but unfortunately due to changes with my work commitments I may not be able to be online for all of them. The moderator for these events will take your questions (or you can send them to me here) and I will write a blog post answering all your questions. Brendan Tierney tag:blogger.com,1999:blog-4669933501315263808.post-8960840801377201332 Mon Dec 11 2017 06:45:00 GMT-0500 (EST) Summary of my 2017 year https://gianniceresa.com/2017/12/summary-2017-year/ <p>December is here, UKOUG Tech17 is over, and this means only one thing: end of year is coming.</p> <p>I generally like to take few minutes to look back to my year and review what I did, so I can better plan the year after.</p> <h2>Five conferences</h2> <p>This year, like already 2016, was rich in travels and conferences for me. It started with Finland and <a href="http://www.ougf.fi/index.php/en/" target="_blank" rel="noopener">OUGF</a> Harmony 2017 in Helsinki, followed by a Italy and <a href="http://www.itoug.it/" target="_blank" rel="noopener">ITOUG</a> Tech Day 2017 in Milano and Netherlands with <a href="https://www.nloug.nl/" target="_blank" rel="noopener">nlOUG</a> Tech Experience 2017. Then some calmer months and it started again with Germany and <a href="https://www.doag.org/en/home/" target="_blank" rel="noopener">DOAG</a> 2017 in Nuremberg and finally United Kingdom with <a href="https://www.ukoug.org/home/" target="_blank" rel="noopener">UKOUG</a> Tech17 in Birmingham.</p> <p>Topics were various: from DevOps with Docker for OBIEE, to building a RPD from scratch in 45 minutes. From Oracle Data Visualization Desktop custom plugins to EPM sources in OBIEE.</p> <h2>Ups and downs blogging</h2> <p>This year has also been probably the first full year for my blog (yes, this one). I do not really have fixed schedules for writing, it depends instead on what I do and discover or experience. One of the main topics of the year has been Docker of course.</p> <p><a href="https://gianniceresa.com/2017/09/obiee-12c-docker-from-scratch/" target="_blank" rel="noopener">Docker</a> clearly changed my way to work with Oracle tools starting from mid 2016. Nowadays most of my sandboxes and environments are Docker based. It&#8217;s easier, faster and require less resources, so definitely a positive thing.<br /> Only exceptions are the pre-built VM like <a href="http://www.oracle.com/technetwork/middleware/bi-foundation/obiee-samples-167534.html" target="_blank" rel="noopener">OBIEE SampleApp</a> or weird VMs like Exalogic to install HFM, Planning and Essbase on Linux.</p> <h2>Oracle ACE</h2> <p>Finally, last but definitely not least: getting an email informing me that I have been chosen to receive the Oracle ACE award. This clearly made my year !</p> <p><img class="alignleft size-full wp-image-589" src="https://gianniceresa.com/wp-content/uploads/2017/12/O_ACELogo_clr.gif" alt="Oracle ACE" width="144" height="54" />I&#8217;m really proud and happy to be an Oracle ACE. My career started reading and following few Oracle ACE and ACE Directors who were sharing their knowledge and experience online on blog posts and conferences. Also thanks to them I kept improving and learning more things.</p> <p>At some point I had the feeling it was now time to start giving back to the community what I received and that&#8217;s when I started presenting at conferences, writing blogs, contributing to the Oracle Developer Community forums etc.</p> <p>There is still a missing point I will keep trying to develop: manage to contribute to an Oracle User Group directly by setting up an event or meetups. So far it didn&#8217;t work also because of &#8220;political&#8221; issues on how local groups are managed and run. But I don&#8217;t give up on this one !</p> <h2>What about 2018?</h2> <p>Next year will probably be similar to 2017. I already sent many abstracts to various conferences and already got some replies. Unfortunately I also already had to cancel one conference where I was selected to speak because of agenda and budgeting conflicts, but I still count in attending at least 3-4 event over the year.</p> <p>Still not sure about the topics which are going to keep me busy in 2018, for sure some graph database if only Oracle focus a bit on on-prem solutions again instead of cloud only. OBIEE &amp; related tools for sure as I will not really give up so easily until the tools are dead.</p> <p>And for sure I will also keep answering on the ODC forums as it&#8217;s also a place where I get some ideas for blog posts (when same questions come back again and again it must means there is still space to fill covering that topic).</p> <p>So &#8230; stay tuned!</p> <p>The post <a rel="nofollow" href="https://gianniceresa.com/2017/12/summary-2017-year/">Summary of my 2017 year</a> appeared first on <a rel="nofollow" href="https://gianniceresa.com">Gianni&#039;s world: things crossing my mind</a>.</p> Gianni Ceresa https://gianniceresa.com/?p=591 Sun Dec 10 2017 12:19:31 GMT-0500 (EST) UKOUG Tech17: Chocolate and Knowhow Sharing https://danischnider.wordpress.com/2017/12/10/ukoug-tech17-chocolate-and-knowhow-sharing/ <p>For the first time, I had the chance to attend and speak at the UKOUG Technology Conference. In these three days at UKOUG Tech17 in Birmingham, I attended some very good sessions, had many interesting discussions about Oracle databases, data warehousing and performance tuning, met nice people and tasted a lot of chocolate.</p> <p><span id="more-530"></span></p> <p><img title="inmemory_dwh.jpg" src="https://danischnider.files.wordpress.com/2017/12/iinmemory_dwh.jpg?w=600&#038;h=300" alt="Inmemory dwh" width="600" height="300" border="0" /><br /><em>My session about Oracle Database In-Memory (Photo: Twitter <a href="https://twitter.com/Boneist/status/938427105288781824">@Boneist</a>)</em></p> <p>In my presentation <a href="https://danischnider.files.wordpress.com/2017/12/ukoug_inmemory_and_dwh.pdf">Oracle Database In-Memory &amp; Data Warehouse: The Perfect Combination?</a> I made a little joke about Swiss chocolate (&#8220;the compression ratio of Toblerone in UK is lower than in the rest of the world&#8221;). That was not the only part about chocolate at the <a href="http://tech17.ukoug.org">UKOUG Tech17</a>. Chocolate and other food and drinks seem to be an important part of this conference. <a href="https://twitter.com/ChandlerDBA">Neil Chandler</a> presented a session about histograms and chocolate, <a href="https://twitter.com/richardfoote">Richard Foote</a> talked about the response time of buying milk, and I heard some rumours that <a href="https://twitter.com/ora600pl">Kamil Stawiarski</a> mentioned beer in his session about tablespaces (unfortunately I missed this presentation).</p> <p><img title="richardfoote.jpg" src="https://danischnider.files.wordpress.com/2017/12/irichardfoote.jpg?w=310&#038;h=200" alt="Richardfoote" width="310" height="200" border="0" /> <img title="neilchandler.jpg" src="https://danischnider.files.wordpress.com/2017/12/ineilchandler.jpg?w=254&#038;h=200" alt="Neilchandler" width="254" height="200" border="0" /><br /><em>Richard Foote talks about milk, Neil Chandler about chocolate</em></p> <p>Despite allusions to food and drinks, the UKOUG Tech17 was <span style="text-decoration:underline;">not</span> a gourmet conference. Fortunately I was prepared to the quality of food and coffee from <a href="https://twitter.com/MDWidlake">Martin Widlake</a>’s blog post <a href="https://mwidlake.wordpress.com/2017/11/29/ukoug-conference-survival-guide/">UKOUG Conference Survival Guide</a>. But the quality of coffee should not be the reason to go to a technical conference. The content of the sessions is much more important, and here the quality was <span style="text-decoration:underline;">much</span> better. Unlike some of my colleagues, I used most of the time to attend as many sessions as possible. Sometimes it was hard to decide, because there were so many interesting subjects to listen to at the same time. Up to 11 sessions were presented in parallel (even more, if you count the Apps17 and JDE17 sessions that were available, too). Fortunately, a good mobile app is available for the conference. This allowed me to plan my schedule and find the most interesting sessions for me. I mainly attended sessions of the Database and the Business Analytics stream, 5 to 6 sessions on each day. Most of them were good or even excellent from my point of view. In a very few cases, I expected something else from the title and abstract of a session. But switching to another session was almost impossible, because the rooms in the ICC Birmingham are spread all over the building, and it takes a long time to walk to another session (and to find the right room).</p> <p>Although I was listening to many presentations, there was still time for chats and discussions with colleagues, other speakers and attendees. Thanks to my Trivadis colleague <a href="https://twitter.com/ChrisAntognini">Christian Antognini</a>, I had the opportunity to talk to <a href="https://twitter.com/vldbb">Nigel Bayliss</a>, product manager of the Oracle optimizer. Because we had some performance problems with incremental statistics a few days ago in a customer project, I was interested to talk to him about the changes in Oracle 12.2 in this area. Details will follow in my next blog post &#8211; hopefully soon.</p> <p>A complete description of all the sessions I attended would go too far in this blog post. I limit the summary on three highlights, one on each of the conference days:</p> <ul> <li>On Monday, I attended Richard Foote’s presentation <a href="http://tech17.ukoug.org/default.asp?p=16630&amp;dlgact=shwprs&amp;prs_prsid=13329&amp;day_dayid=116">Real World Examples on how to use AWR Reports to Solve Performance Issues</a>. In this very entertaining session, Richard Foote explained several examples of AWR reports to show different kinds of performance issues that may happen in real projects. Of course, he changed the reports slightly (all databases were called BOWIE and the servers usually ZIGGY), but the examples showed impressively how you can proceed to find the source of a performance problem as fast as possible.</li> <li>On Tuesday, before the session <a href="http://tech17.ukoug.org/default.asp?p=16630&amp;dlgact=shwprs&amp;prs_prsid=13313&amp;day_dayid=118">Five Things you Might not Have Known About the Oracle Database</a> of <a href="https://twitter.com/SQLMaria">Maria Colgan</a> and <a href="https://twitter.com/dominic_giles">Dominic Giles</a>, I was quite sure I will know all the “five things”. But during the session I wrote down several interesting details (even more than five) that I did not know. The session inspired me to read more in the Oracle documentation. There is always something “new” to discover and features to investigate.</li> <li>On Wednesday, the session <a href="http://tech17.ukoug.org/default.asp?p=16630&amp;dlgact=shwprs&amp;prs_prsid=13008&amp;day_dayid=120">Histograms are Evil Like Chocolate is Evil</a> of <a href="https://twitter.com/ChandlerDBA">Neil Chandler</a> was not only very entertaining, but informative too. Neil introduced the different types of histograms and the extensions in Oracle 12c, but also explained in detail how they can be efficiently used and configured and in which cases histograms may cause problems. A very good presentation about a subject I thought do be familiar with, but learned some more details about it.</li> </ul> <p>Currently, not all presentations are available (yet) in the UKOUG download area. I hope that this will change, because it’s worth for me to browse through some of the slides again.</p> <p>The title of Neil’s presentation brings us back to the chocolate: A few days before the UKOUG Tech17 conference, I became an Oracle ACE. Therefore, I was invited to the Oracle ACE Dinner on Monday evening and to a chocolate tasting on Tuesday. As far as I knew before from Twitter, this chocolate tasting seems to be traditional on many conferences, so I hope that I don’t eat too much chocolate in the next few years. Anyway &#8211; it was not only a pleasure to taste and compare chocolate from all parts of the world, but mainly to meet other Oracle ACEs and talk to them about Oracle stuff, but also about chocolate, beer and other important topics.</p> <p><img title="chocolate_tasting.jpg" src="https://danischnider.files.wordpress.com/2017/12/ichocolate_tasting.jpg?w=450&#038;h=600" alt="Chocolate tasting" width="450" height="600" border="0" /><br />Chocolate tasting, organized by <a href="https://twitter.com/oracleace">Oracle ACE Program</a></p> <p><img title="ace_dinner.jpg" src="https://danischnider.files.wordpress.com/2017/12/iace_dinner.jpg?w=450&#038;h=253" alt="Ace dinner" width="450" height="253" border="0" /><br />Oracle ACE Dinner (Photo: Twitter <a href="https://twitter.com/oracleace/status/938004639177494529">@connor_mc_d</a>)</p> <p><img title="chocolate_tasting2.jpg" src="https://danischnider.files.wordpress.com/2017/12/ichocolate_tasting2.jpg?w=450&#038;h=255" alt="Chocolate tasting2" width="450" height="255" border="0" /><br />Chocolate tasting (Photo: Twitter <a href="https://twitter.com/lleturgez/status/938127421190098944">@lleturgez</a>)</p> Dani Schnider http://danischnider.wordpress.com/?p=530 Sun Dec 10 2017 11:40:12 GMT-0500 (EST) Why Is It So Difficult to Maintain Data Consistency Across the Enterprise? https://www.us-analytics.com/hyperionblog/why-is-it-so-difficult-to-maintain-data-consistency-across-the-enterprise <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/why-is-it-so-difficult-to-maintain-data-consistency-across-the-enterprise" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/inconsistent-data-poor-quality.jpeg?t=1519157959954" alt="Why Is It So Difficult to Maintain Data Consistency Across the Enterprise?" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span style="background-color: transparent;">Establishing a common set of data parameters that your organization follows seems like it should be simple, but the truth is that every group needs their own view of the data. Consider a simple concept like “Total Monthly Sales.” If I’m speaking from a sales group perspective, I’m referring to all the business my sales organization closed in the time period I’m reporting for. If, on the other hand, I’m asking the group controller, his definition is going to reflect all closed business that has been booked to the ledger.</span></p> <p>Hence, at month end, when the CEO is trying to review how the organization is doing against the stated goals, the answer he gets for “Total Monthly Sales” will be different based on whom he asks. The detrimental effect of alternate views is the inconsistency of data across the organization. Departmental management makes operational decisions based on what they perceive is the truth, and corporate management makes strategic decisions based on these perceptions. If the data is not the same, it is easy to see how operational decisions can conflict or adversely affect the strategic corporate goals.</p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fwhy-is-it-so-difficult-to-maintain-data-consistency-across-the-enterprise&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> US-Analytics https://www.us-analytics.com/hyperionblog/why-is-it-so-difficult-to-maintain-data-consistency-across-the-enterprise Fri Dec 08 2017 14:04:00 GMT-0500 (EST) ODTUG December News http://www.odtug.com/p/bl/et/blogaid=754&source=1 The ODTUG December News includes information about the abstract public voting sign-ups, ODTUG Kscope18 Community Service Day donations, Oracle Cloud Customer Connect upcoming webinars, ODTUG community news, and upcoming ODTUG webinars. ODTUG http://www.odtug.com/p/bl/et/blogaid=754&source=1 Thu Dec 07 2017 11:34:37 GMT-0500 (EST) Choosing a Planning & Forecasting Method https://www.us-analytics.com/hyperionblog/choosing-a-planning-forecasting-method <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/choosing-a-planning-forecasting-method" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/3-steps-faster-financial-forecasting-1.jpg?t=1512662316771" alt="3-steps-faster-financial-forecasting-1.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span>Many companies are considering ditching traditional budgeting for more flexible or more detailed methods.</span></p> <p><span><span><strong>Choosing a new method calls for careful consideration — understanding what will realistically work for your organization.&nbsp;</strong></span></span><span>Read on to explore alternative methods and the various facets of each, including:</span></p> <ul> <li><span>The pros and cons of rolling forecasts</span></li> <li><span>The pros and cons of zero-based budgeting</span></li> <li><span>Challenges that come with each method</span></li> <li><span>Getting started with each method</span></li> <li><span>Tools to optimize and support the method you choose</span></li> <li><span>And more!</span></li> </ul> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fchoosing-a-planning-forecasting-method&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/choosing-a-planning-forecasting-method Thu Dec 07 2017 11:31:46 GMT-0500 (EST) 3 Signs You Need to Automate Your Account Reconciliation Process https://www.us-analytics.com/hyperionblog/3-signs-you-need-to-automate-your-account-reconciliation-process <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/3-signs-you-need-to-automate-your-account-reconciliation-process" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/3%20Reasons%20Why%20You%20Should%20Automate%20Your%20Account%20Reconcilation%20Process.jpg?t=1519157959954" alt="3 Reasons Why You Should Automate Your Account Reconcilation Process.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><span><br>For most organizations, the account reconciliation process is manual, time consuming, and a major bottleneck in the financial close process. Medium to large companies commonly reconcile thousands of accounts during the quarter-end or <a href="https://www.us-analytics.com/oracle-hfm-administration-5-tips-for-a-stress-free-month-end-close">month-end close</a>, yet <strong>65 percent rely on manual methods to determine whether adjustments are required</strong>.&nbsp;</span></p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2F3-signs-you-need-to-automate-your-account-reconciliation-process&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Yasmin Morrison https://www.us-analytics.com/hyperionblog/3-signs-you-need-to-automate-your-account-reconciliation-process Wed Dec 06 2017 13:26:00 GMT-0500 (EST) Rittman Mead at UKOUG 2017 http://www.rittmanmead.com/blog/2017/12/rittman-mead-at-ukoug-2017/ <p>For those of you attending the <a href="http://tech17.ukoug.org">UKOUG</a> this year, we are giving three presentations on OBIEE and Data Visualisation.</p> <p>Francesco Tisiot has two on Monday:</p> <ul> <li>14.25 // Enabling Self-Service Analytics With Analytic Views &amp; Data Visualization From Cloud to Desktop - Hall 7a</li> <li>17:55 // OBIEE: Going Down the Rabbit Hole - Hall 7a</li> </ul> <p>Federico Venturin is giving his culinary advice on Wednesday:</p> <ul> <li>11:25 // Visualising Data Like a Top Chef - Hall 6a</li> </ul> <p>And Mike Vickers is diving into BI Publisher, also on Wednesday</p> <ul> <li>15:15 // BI Publisher: Teaching Old Dogs Some New Tricks - Hall 6a</li> </ul> <p>In addition, Sam Jeremiah and I are also around, so if anyone wants to catch up, grab us for a coffee or a beer.</p> Jon Mead 2dff70aa-02af-44ea-b292-b1443d25fe9f Mon Dec 04 2017 03:58:46 GMT-0500 (EST) PBCS and EPBCS Updates (December 2017): Support Removed for Workspace, Using Firefox with Smart View, and More https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2017-december-updates <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2017-december-updates" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/PBCS%20and%20EPBCS%20December%20update.jpg?t=1519157959954" alt="PBCS and EPBCS December update.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The December updates for Oracle's<span>&nbsp;</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">Planning &amp; Budgeting Cloud Service (PBCS) and Enterprise Planning and Budgeting Cloud Service (EPBCS)</a><span>&nbsp;are here.&nbsp;</span>This blog post outlines several new features for both applications, enhancements, removal of support, and fixed defects.</p> <p><em>The monthly update for PBCS and EPBCS will occur on Friday, December 15 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fpbcs-and-epbcs-2017-december-updates&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/pbcs-and-epbcs-2017-december-updates Fri Dec 01 2017 14:23:00 GMT-0500 (EST) FCCS Updates (December 2017): Advanced Consolidation Features, New Custom Functions, and More https://www.us-analytics.com/hyperionblog/fccs-updates-december-2017 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/fccs-updates-december-2017" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/FCCS%20december%20update.jpg?t=1519157959954" alt="FCCS december update.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The December updates for <a href="https://www.us-analytics.com/hyperionblog/faq-oracle-financial-consolidation-and-close-cloud-service-fccs">Oracle's<span>&nbsp;Financial Consolidation and Close Cloud Service</span>&nbsp;(FCCS)</a><span> are here</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">.</a><span>&nbsp;</span>This blog post outlines an array of new features, fixed defects, considerations, and more.</p> <p><em>The monthly update for FCCS will occur on Friday, December 15 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Ffccs-updates-december-2017&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/fccs-updates-december-2017 Fri Dec 01 2017 13:40:00 GMT-0500 (EST) EPRCS Updates (December 2017): Considerations for Management Reporting, Report Packages, and More https://www.us-analytics.com/hyperionblog/eprcs-updates-december-2017 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/eprcs-updates-december-2017" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/EPRCS%20december%20update.jpg?t=1519157959954" alt="EPRCS Updates (December 2017): Considerations for Management Reporting, Report Packages, and More" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The December updates for <a href="https://www.us-analytics.com/hyperionblog/enterprise-performance-reporting-cloud">Oracle Enterprise Performance Reporting Cloud Service (EPRCS)</a><span>&nbsp;are here</span><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">.</a><span>&nbsp;</span>This blog post outlines new features, fixed defects, and considerations.</p> <p><em>The monthly update for EPRCS will occur on Friday, December 15 during your normal daily maintenance window.</em></p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Feprcs-updates-december-2017&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/eprcs-updates-december-2017 Fri Dec 01 2017 12:49:00 GMT-0500 (EST) ARCS Updates (December 2017): On-Prem to Cloud Migration, Removal of Support, and More https://www.us-analytics.com/hyperionblog/arcs-product-update-december-2017 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/arcs-product-update-december-2017" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/ARCS%20december%20update.jpg?t=1519157959954" alt="ARCS december update.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The December updates for Oracle's<span>&nbsp;</span><a href="https://www.us-analytics.com/hyperionblog/faq-account-reconciliation-cloud-service-arcs">Account Reconciliation Cloud Service (ARCS</a>) are here. In this blog post, we’ll outline new guidelines for on-prem to cloud migration, fixed defects, and considerations.</p> <p>We’ll let you know any time there are updates to ARCS or any other Oracle EPM cloud products. Check the&nbsp;<a href="https://www.us-analytics.com/hyperionblog">US-Analytics Oracle EPM &amp; BI Blog</a><span>&nbsp;</span>every month.</p> <p><em>The monthly update for Oracle ARCS will occur on Friday, December 15 during your normal daily maintenance window.</em></p> <h3 style="text-align: center;"></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Farcs-product-update-december-2017&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/arcs-product-update-december-2017 Fri Dec 01 2017 11:36:00 GMT-0500 (EST) Upcoming December Webinars http://www.odtug.com/p/bl/et/blogaid=753&source=1 ODTUG's Online Education: Is there a topic you would like covered but do not see here? We are happy to take webinar suggestions. Email us at kgately@odtug.com. ODTUG http://www.odtug.com/p/bl/et/blogaid=753&source=1 Thu Nov 30 2017 12:19:10 GMT-0500 (EST) OBIA 11g : Analyzing ODI ETL Load Performance - Part 2 https://blogs.oracle.com/biapps/obia-11g-%3A-analyzing-odi-etl-load-performance-part-2 <p style="text-align: justify;">In the <a href="https://blogs.oracle.com/biapps/obia-11g-%3a-analyzing-odi-etl-load-performance-part-1">part1</a> in this series, we showed how you can identify the top running maps in a load plan. In this blog, we list certain parameter/settings at ODI/Database/Network level that can influence the overall load plan timings.</p> <u>ODI Settings</u> <p style="text-align: justify;">1) Check the number of parallel sessions configured against the ODI agent. Recommendation is to have NOT more than 5 ODI sessions configured to run in parallel. If your server is not sized up properly, this may have to be reduced further. You can find this setting against the definition of the ODI Physical&nbsp; agent&nbsp;&nbsp;- Maximum number of parallel sessions property (in ODI studio).<br /> &nbsp;<br /> 2) Confirm if memory settings for the ODI Managed server are as per the BIAPPS technote. Refer to the following doc id in My Oracle Support website which specifies the recommended memory settings. Oracle Business Intelligence Applications Version 11g Performance Recommendations (Doc ID <a href="https://support.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1963225.1">1963225.1</a>)</p> <p style="text-align: justify;">3) Ensure that you are on the relevant ODI patches. Refer to the BIAPPS documentation/certification matrix for your BIAPPS release to get the exact ODI patch to be on.</p> <p style="text-align: justify;">3) Check the WLS settings for Connection pool of ODI repository in WLS. Below are the recommended WLS settings.</p> <ol> <li style="text-align: justify;"><strong>Initial Capacity</strong> - The number of connection that will be opened when WLS starts. Set to 5 for frequent used ones like ODI and BIACOMP.</li> <li style="text-align: justify;"><strong>Minimum Capacity - </strong>The minimum number of physical connections that this connection pool will always contain after it is initialized. Set to <strong>5</strong> for all repositories with high load (E.g. ODI, SDS, BIACOMP)</li> <li style="text-align: justify;"><strong>Maximum Capacity - </strong>The maximum number of physical connections that this connection pool can contain. <ol> <li>Master, Work, BIACOMP and SDS repositories should be set to <strong>100</strong>.</li> <li>This parameter can be modified based on the customer hardware configuration, which might help improve the overall LP (if the customer finds UNKNOWN Gaps in LP). It is found that CPU utilization increases when this parameter is higher.</li> </ol> </li> <li style="text-align: justify;"><strong>Shrink Frequency - </strong>The number of seconds to wait before shrinking a connection pool that has incrementally increased to meet demand. For all connections this should be <strong>300</strong>. This will then match the TestFrequency and ensure that the connections are released if not used.&nbsp;</li> <li style="text-align: justify;"><strong>Seconds to Trust an Idle Pool Connection -</strong> The number of seconds within the last usage of a connection, that WebLogic Server trusts that the connection is still viable and will skip the connection test, either before delivering it to an application or during the periodic connection testing process.Should be <strong>10 </strong>for all repositories to prevent unnecessary tests. 10 is weblogic default and recommendation for production environments</li> </ol> <p style="text-align: justify;">5) If the SDE mappings are taking long, the customer can experiment with the Array Fetch Size against the ODI physical connections. The array fetch size against the source/target connection is known to impact the load duration.</p> <p style="text-align: justify;">6) Ensure the ODI repository database schema has been analyzed. If you have done a lot of load plan runs, consider purging old ODI session logs to reduce the size of the ODI repository database.</p> <u>Database Settings</u> <p style="text-align: justify;">1) Check the number of sessions and processes setup at your database. Set processes parameter to atleast 500 and sessions parameter to atleast 3000 for the database. Run the below query with a DBA user to check the current setting.<br /> SELECT NAME,VALUE FROM V$PARAMETER WHERE name in (&#39;processes&#39;,&#39;sessions&#39;);</p> <p style="text-align: justify;">2) For Full load , you could consider keeping the database in NOARCHIVELOG mode with forcelogging turned off. Refer to BIAPPS Performance tech note Oracle Business Intelligence Applications Version 11g Performance Recommendations (Doc ID <a href="https://support.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1963225.1">1963225.1</a>). Note: NOARCHIVELOG mode can impact the ability to restore the database in case of a crash. So please talk to the DBA before deciding to use this option.</p> <p style="text-align: justify;">3) Ensure redo logs are adequate. The default of 3 redo logs, each of 50MB size is not adequate for BIAPPS loads especially when the volumes are high. Refer to tech note above.</p> <p style="text-align: justify;">4) Ensure SDS/DW/ODI/BIACM schemas have adequate free tablespace size. Also if the tablespaces files are set to autoextend, ensure that the increment by is set adequately high (Especially for DW and SDS schemas). Consider setting incrementby from 500MG to 1GB for DW/SDS tablespace files. Before full load, estimate the size of your database and then ensure that the initial size of the tablespace is big enough to hold the data.</p> <p style="text-align: justify;">5) Run AWR reports and use SQL advisor periodically to fine tune long running queries.</p> <p style="text-align: justify;">6) Partition large fact tables. Tables are not partitioned Out of the box.</p> <u>Network Settings</u> <p style="text-align: justify;">1) Ensure that ODI agent is as close as possible to the Database. They should be on the same LAN at a minimum.&nbsp;</p> <p style="text-align: justify;">2) Ensure there are no timeouts set at either the database or the network especially for the connection used by the ODI agent. Agent connections can tend to remain inactive for a long time (more than an hour for long running load plans). If Sessions remain in a particular state and nothing is happening for long and you don&#39;t notice any activity in the database, then agent might have lost connection with the ODI repository. Refer to the ODI Documentation on Stale Sessions for more details. Typically an agent restart should fix the problem. However check where the timeouts are present and then relax/remove them for ODI connections.&nbsp;</p> Gunaranjan Vasireddy https://blogs.oracle.com/biapps/obia-11g-%3A-analyzing-odi-etl-load-performance-part-2 Thu Nov 30 2017 04:10:00 GMT-0500 (EST) My Sessions at DOAG 2017 https://danischnider.wordpress.com/2017/11/30/my-sessions-at-doag-2017/ <p>This year, I had the opportunity to present three sessions at the DOAG conference in Nuremberg &#8211; one on each conference day. Here a short summary of the sessions and links to the downloads.</p> <p><span id="more-511"></span></p> <p>Like every year, the DOAG conference in Nuremberg, organized by the German Oracle User Group (DOAG), was an exciting and well organized event. I had the pleasure to listen to many interesting presentations, meet colleagues, friends, customers and other interesting people, and have a lot of interesting chats and discussions. Of course, I could write a few words about each session I attended, but the risk that I forgot somebody to mention would be too high. So, I focus on my own sessions in this blog post.</p> <p> </p> <h1>Analytic Views: Einsatzgebiete im Data Warehouse</h1> <p><strong><em>(Analytic Views: Use Cases in Data Warehouse)</em></strong></p> <p>In this presentation, I explained the concepts of the three new metadata objects <em>Attribute Dimension</em>, <em>Hierarchy </em>and <em>Analytic View</em> in Oracle 12c Release 2 and showed some demos of how they can be used in SQL queries. In data warehouses, they will typically be used in BI tools, in ad-hoc queries or as source for specific ETL jobs. From my point of view, the success (or failure) of this very powerful and flexible database feature depends on the integration with BI tools. As soon as there are easy-to-use import functions available in tools like OBIEE, there is a good chance that Analytic Views will be used in many data warehouse environments. The live demos in the presentation were based on the Oracle Live SQL tutorial <a href="https://livesql.oracle.com/apex/livesql/file/tutorial_EDVE861IJ168OTUP6ZZ01MX84.html">Creating an Analytic View for the Sales History (SH) Sample Schema</a>.</p> <p>Downloads: <a href="https://danischnider.files.wordpress.com/2017/11/doag2017_analytic_views_en.pdf">Presentation (English)</a>, <a href="https://danischnider.files.wordpress.com/2017/11/doag2017_analytic_views.pdf">Presentation (German)</a>, <a href="https://danischnider.files.wordpress.com/2017/11/doag_analytic_views.pdf">Article (German)</a></p> <p><img title="Analytic_Views.jpg" src="https://danischnider.files.wordpress.com/2017/11/ianalytic_views1.jpg?w=600&#038;h=450" alt="Analytic Views" width="600" height="450" border="0" /></p> <p><em>Photo: Twitter (<a href="https://twitter.com/ABuckenhofer/status/932945951823745024">@Buckenhofer</a>)</em></p> <p> </p> <h1>Data Vault Forum</h1> <p>Since a couple of years, a forum session for the Data Vault community is organized as part of the DOAG conference. Its purpose is to share knowledge and practical experience from different Data Vault projects. Because the community of this data modeling technique is still small in German speaking countries, most of the attendees of this session were the same as last year. But nevertheless we had interesting discussions about the choice of suitable business keys, bi-temporal historization, validities of Links and the performance of data extraction from Data Vault. Actually, it was planned that my Trivadis colleague Peter Welker will chair this forum session, but because he had another appointment at the same time, he asked me to lead the discussion. So, it was not one of “my” sessions, to be honest.</p> <p><img title="Data_Vault_Forum.jpg" src="https://danischnider.files.wordpress.com/2017/11/idata_vault_forum1.jpg?w=597&#038;h=164" alt="Data Vault Forum" width="597" height="164" border="0" /></p> <p><em>Photo: Twitter (<a href="https://twitter.com/dani_schnider/status/933366926969012224">@dani_schnider</a>) </em></p> <p> </p> <h1>Partitionierungsstrategien im Data Warehouse</h1> <p><strong><em>(Data Vault Partitioning Strategies)</em></strong></p> <p>Loading data into a Data Vault schema is easy, but how to extract information from there in an efficient way? This is a typical challenge in many Data Vault projects, when the number and the size of tables increases during the lifecycle of the data warehouse system. Partitioning tables in Data Vault can help to solve this problem, but what is the best way to do that? In this session, I introduced three different partitioning strategies that can help to solve performance issues in Data Vault. Although I had the idea for this session in a customer project at the beginning of this year, I used an imaginary “project” for my presentation: a craft beer brewery. In addition to the presentation, I published a <a href="https://danischnider.files.wordpress.com/2017/11/wp_data_vault_partitioning_strategies3.pdf">Trivadis white paper “Data Vault Partitioning Strategies”</a> just before the DOAG conference. It contains the same strategies and examples as the presentation, but explains more details for each partitioning approach.</p> <p>Downloads: <a href="https://danischnider.files.wordpress.com/2017/11/doag2017_data_vault_partitioning_en.pdf">Presentation (English)</a>, <a href="https://danischnider.files.wordpress.com/2017/11/doag2017_data_vault_partitioning.pdf">Presentation (German)</a>, <a href="https://danischnider.files.wordpress.com/2017/11/doag_data_vault_partitionierung.pdf">Article (German)</a></p> <p><img title="DV_Partitioning.jpg" src="https://danischnider.files.wordpress.com/2017/11/idv_partitioning1.jpg?w=600&#038;h=450" alt="DV Partitioning" width="600" height="450" border="0" /></p> <p><em>Photo: Twitter (<a href="https://twitter.com/dani_schnider/status/933665417167560704">@dani_schnider</a>)</em></p> Dani Schnider http://danischnider.wordpress.com/?p=511 Wed Nov 29 2017 19:09:30 GMT-0500 (EST) Using the Oracle Data Visualization Dimension Player Plugin http://blog.performancearchitects.com/wp/2017/11/29/using-the-oracle-data-visualization-dimension-player-plugin/ <p>Author: Cameron Ross, Performance Architects</p> <p>Oracle’s <a href="http://www.oracle.com/technetwork/middleware/oracle-data-visualization/index.html">Data Visualization (DV) Desktop</a> provides users with the ability to quickly generate visualizations at the click of a button. One neat feature of DV Desktop is the ability to implement newly-released plugins from the <a href="https://www.oracle.com/solutions/business-analytics/data-visualization/library.html">Oracle Analytics Library</a>, where you will find a plugin called the “Dimension Player.” This plugin gives you the ability to quickly filter your visualizations using any of your dimensional columns.</p> <p>To get the Dimension Player go to the Analytics Library, search for “Dimension Player,” and then click “Download:”</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR1.png"><img class="alignnone size-medium wp-image-2193" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR1-163x300.png" alt="" width="163" height="300" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR1-163x300.png 163w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR1-556x1024.png 556w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR1.png 563w" sizes="(max-width: 163px) 100vw, 163px" /></a></p> <p>Once the plugin completes downloading, find the “DV Desktop” install in the file directory. Once there, copy and paste the zipped file into the folder labeled “Plugins” (if this is the first time you’re bringing in a custom plugin, then you’ll need to create the folder).</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR2.png"><img class="alignnone size-medium wp-image-2192" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR2-300x180.png" alt="" width="300" height="180" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR2-300x180.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR2-768x462.png 768w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR2-1024x616.png 1024w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR2-624x375.png 624w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>Once the zip file is imported into the “Plugins” folder, start up your DV Desktop instance. Create a new project using any of the data sources. Using the left side of the screen, click the “Visualizations” tab and verify that the new “Dimension Player” visual is there:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR3.png"><img class="alignnone size-medium wp-image-2191" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR3-130x300.png" alt="" width="130" height="300" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR3-130x300.png 130w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR3-444x1024.png 444w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR3.png 577w" sizes="(max-width: 130px) 100vw, 130px" /></a></p> <p>Next, we will create a simple bar chart that displays “Product Subcategory” and “Sales” to show how the Dimension Player impacts this visual. Using the “Year” column in the Dimension Player, this automatically changes the graph based off of the years given.</p> <p>2013:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4.png"><img class="alignnone size-medium wp-image-2190" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4-300x183.png" alt="" width="300" height="183" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4-300x183.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4-768x469.png 768w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4-1024x626.png 1024w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4-624x381.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR4.png 1555w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>2014:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5.png"><img class="alignnone size-medium wp-image-2189" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5-300x183.png" alt="" width="300" height="183" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5-300x183.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5-768x470.png 768w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5-1024x626.png 1024w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5-624x382.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR5.png 1552w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>2015:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6.png"><img class="alignnone size-medium wp-image-2188" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6-300x183.png" alt="" width="300" height="183" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6-300x183.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6-768x468.png 768w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6-1024x624.png 1024w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6-624x380.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/CR6.png 1553w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>The Dimension Player can be a very useful tool if there are a set of visuals that are better seen through all of the different options of a dimensional column (Gender, Race, Year, Location, etc.). The nicest part is that all of this can be done with the click of the button. This is just one of many visualizations that are on the Oracle Analytics Library page that can bring lots of value to any DV project and make portraying data much easier for the end user.</p> Melanie Mathews http://blog.performancearchitects.com/wp/?p=2187 Wed Nov 29 2017 05:14:14 GMT-0500 (EST) Orlando From the Eyes of a Local http://kscope18.odtug.com/p/bl/et/blogaid=752&source=1 With ODTUG Kscope18 just over 6 months away, we're getting very excited about all the activities and attractions that Orlando has to offer! Here's a list of a few "hot spots" that we encourage you to check out during your stay in Orlando. ODTUG http://kscope18.odtug.com/p/bl/et/blogaid=752&source=1 Tue Nov 28 2017 09:45:44 GMT-0500 (EST) Orlando From the Eyes of a Local http://www.odtug.com/p/bl/et/blogaid=752&source=1 With ODTUG Kscope18 just over 6 months away, we're getting very excited about all the activities and attractions that Orlando has to offer! Here's a list of a few "hot spots" that we encourage you to check out during your stay in Orlando. ODTUG http://www.odtug.com/p/bl/et/blogaid=752&source=1 Tue Nov 28 2017 09:45:44 GMT-0500 (EST) Lookering at Version Control https://blog.redpillanalytics.com/lookering-at-version-control-d8e3966b7a8f?source=rss----abcc62a8d63e---4 <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8e1Ue0Z4xScS_9jmzqH7jA.png" /></figure><p>If you follow Red Pill Analytics at all, you know that we have our hands in a bit of everything when it comes to data and analytics; having the opportunity to work with various tools and technologies is one of the many benefits to working at RPA. One particular tool that we have found ourselves working with more and more as of late is <a href="https://looker.com/">Looker</a>. Looker continues to demonstrate success while gaining a ton of traction in the Business Intelligence and Analytics space and has no doubt won the praise of us Red Pillians. Offering both cloud and on-premise options for their customers, Looker is a data visualization tool with a modeling layer. Hold onto that thought.</p><p>And if you follow Red Pill Analytics, you know that we are big fans of all things version control. In fact, if you work with Oracle Business Intelligence Enterprise Edition (OBIEE) and are still using MUDE, passing around a .rpd file so that everyone can “commit to master”, or going as far as designating times that each developer can deploy changes or work online, all things I have seen or experienced working with various clients, you should have a look at <a href="http://redpillanalytics.com/checkmate/">Checkmate</a>. That being said, RPA’s Checkmate is a multi-faceted tool that does more than version control but I digress…</p><p>Back to Looker. At a high level, Looker stores objects in two places — the internal application database for things like metadata, Looks (reports), and some dashboards as well as in files written in LookML, Looker’s proprietary domain-specific language (DSL). LookML is cool. LookML is really cool. It is really cool because it serves as the abstraction layer between the reporting and the database layers and it allows developers to code as simple or as complex as required. In other words: it is flexible. Having the LookML abstraction (or logical, or semantic) layer for modeling provides all of the things a modeling layer should provide: standardization, repeatability, scalability, DRY coding, the list goes on. LookML helps separate Looker from pure data visualization tools and allows it to scale to the enterprise. Don’t get me wrong, there is a time and a place where pure data visualization tools suffice but there are countless use cases where a logical layer of abstraction is a should or even a must have.</p><p>For anyone new to LookML or apprehensive about writing code, Looker does an exceptional job of publishing documentation on <a href="https://docs.looker.com/data-modeling/learning-lookml/what-is-lookml">LookML</a>. The IDE is also intuitive and provides dynamic lists and definitions as LookML is being written. Additionally, auto-complete functionality helps to speed things along.</p><p>What does all of this have to do with version control? The LookML files I have been going on about are typically stored in a Git repository using Looker’s native Git integration. <strong><em>Looker’s native Git integration!</em></strong> After following the four-step process of creating a Git repository, creating a Looker project, linking the project to the repository, and granting Looker access to write to the repository, that is all it takes to get going with a Git-linked Looker project.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BtgQ22E1J__yKvxCnS6eBw.png" /><figcaption>That’s the ticket!</figcaption></figure><p>Looker maintains a master branch and a development branch specific to each developer’s user account. Depending on the project configurations, developers can develop on his or her branch, commit code, and commit to master or open a pull request to have code deployed. The Git integration saw some significant enhancements with the release of Looker 5.0. Among the enhancements is the ability to create shared branches, switch branches, and read-only access to other developers’ branches. To grab a quote from RPA’s Stewart Bryson:</p><blockquote>This is truly fantastic. Feature branches. Built right into a BI tool.</blockquote><blockquote>-Stewart, sometime last month, via Slack</blockquote><p>I don’t disagree. Most BI tools either need a third-party companion tool such as Checkmate to manage version control or they can be set up in a round-about way to allow source code to be stored and accessed in a repository but Looker takes the cake on this one. Not that there is anything wrong with third-party applications to manage version control; have I mentioned <a href="http://www.redpillanalytics.com/checkmate">Checkmate</a> yet for those of you using OBIEE? Third-party applications are great but we created Checkmate because there were a handful problems that needed to be solved, one of those being version control. Native version control built right into a BI tool, as Stewart said, is truly fantastic.</p><p>Normally, this topic would be a good candidate to walk through some of the setup and functionality step-by-step but the folks at Looker have already done that <a href="https://docs.looker.com/data-modeling/getting-started/version-control-and-deploying-changes">here</a> and I’m not one for reinventing the wheel. Head on over to the <a href="https://docs.looker.com/">Looker docs</a> and see for yourself.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/225/1*wgUq-3vJiZxLvqZLsK7jEw.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d8e3966b7a8f" width="1" height="1"><hr><p><a href="https://blog.redpillanalytics.com/lookering-at-version-control-d8e3966b7a8f">Lookering at Version Control</a> was originally published in <a href="https://blog.redpillanalytics.com">Red Pill Analytics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p> Mike Fuller https://medium.com/p/d8e3966b7a8f Mon Nov 27 2017 11:46:43 GMT-0500 (EST) Make SQL Great Again baseball cap http://www.oralytics.com/2017/11/blog-post.html Make SQL great again baseball cap <br /><img alt="Screenshot 2017 11 22 12 15 18" border="0" height="512" src="https://lh3.googleusercontent.com/-Xbpa6gW5Naw/WhVqkuLplfI/AAAAAAAAMRU/4EMPqcU1HBgkXsqa6gqO26Pyhkli2tc3ACHMYCw/Screenshot%2B2017-11-22%2B12.15.18.png?imgmax=800" title="Screenshot 2017-11-22 12.15.18.png" width="423" /> <br />Let me know if you would like to order one. <br />They cost €15 + P&amp;P Brendan Tierney tag:blogger.com,1999:blog-4669933501315263808.post-748145500290152518 Wed Nov 22 2017 07:09:00 GMT-0500 (EST) Zero-Based Budgeting: Pros, Cons & What to Know Before Getting Started https://www.us-analytics.com/hyperionblog/zero-based-budgeting <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/zero-based-budgeting" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/zero-based%20budgeting.jpg?t=1519157959954" alt="zero-based budgeting.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>Zero-based budgeting (ZBB) is less common than traditional budgeting and <strong><a href="https://www.us-analytics.com/hyperionblog/should-you-use-rolling-forecasts-weighing-the-pros-and-cons">rolling forecasts</a></strong>. However, it’s been getting some attention in the last few years. Whereas traditional budgeting allows you to include items from the previous year, ZBB requires organizations to justify every dollar in detail.</p> <p>Building a budget from zero might seem like a tedious process, but it can help you make the best decisions for your company in the long run. In this blog post, we’ll cover some of the pros and cons of zero-based budgeting. And, we’ll look at some questions you need to ask before getting started with ZBB in Hyperion Planning.</p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fzero-based-budgeting&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/zero-based-budgeting Tue Nov 21 2017 10:19:51 GMT-0500 (EST) Oracle Data Integration Cloud Platform: Everything You Need to Know https://www.us-analytics.com/hyperionblog/oracle-data-integration-cloud-platform <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/oracle-data-integration-cloud-platform" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/data%20integration.jpg?t=1519157959954" alt="Oracle Data Integration Cloud Platform: Everything You Need to Know" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>Oracle has a new data integration solution in the cloud — combining features from all your favorite on-prem data governance and data integration tools.</p> <p>Oracle’s Data Integration Cloud Platform (DIPC) seeks to bring together everything you need from a data integration, data governance, and data quality solution in one platform. With this one tool, you’re able to connect to hundreds of data sources — on-prem and in the cloud.</p> <p>In this blog post, we’ll cover the features included in DIPC as well as uses cases, benefits, and security.</p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Foracle-data-integration-cloud-platform&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Becky Wagner https://www.us-analytics.com/hyperionblog/oracle-data-integration-cloud-platform Mon Nov 20 2017 17:05:05 GMT-0500 (EST) Using Date Based Partitioning for OTBI Extracts with Data Sync to Improve Performance http://www.ateam-oracle.com/using-date-based-partitioning-for-otbi-extracts-with-data-sync-to-improve-performance/ For other A-Team articles about BICS, OAC, and Data Sync, click here Introduction The Data Sync tool provides the ability to extract from both on-premise, and cloud data sources, and to load that data into BI Cloud Service (BICS), Oracle Analytics Cloud Service (OAC), and other relational databases. I have previously written about the tool&#8217;s ability [&#8230;] Richard Williams http://www.ateam-oracle.com/?p=47450 Mon Nov 20 2017 14:03:55 GMT-0500 (EST) The Good, The Bad, and the Gorgeous https://blog.redpillanalytics.com/the-good-the-bad-and-the-gorgeous-f0cc856e556f?source=rss----abcc62a8d63e---4 <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*X3b3H8SLIHKrokFkTbGR3g.png" /></figure><h4>Some tips, tricks and thoughts on using Google Data Studio</h4><p>Red Pill Analytics recently delivered a solution that exclusively used Google Cloud Platform. Our client, a marketing team at Google, wanted to know how they were engaging with users across several online channels. We used Google Analytics, YouTube Analytics, AdWords, among other sources via BigQuery to bring data into Data Studio. For those of you not aware, Data Studio is Google’s cloud data visualization offering. (You can read more about what Google has to say about it <a href="https://www.google.com/analytics/data-studio/">here</a>).</p><h4>Are You Connected?</h4><p>Data Studio has a large number of native connectors that will allow you to connect to data in sources such as Google Analytics, YouTube Analytics, BigQuery, MySQL, and Google Sheets to name a few. A criticism I first had about Data Studio was the inability to join data sources within the application. Simply put, if you want to import several sources into Data Studio and use them in one visualization, you will have to combine them elsewhere. For several of our data sources, this was no big deal. In fact, Google Analytics data in particular works flawlessly with the Google Analytics native connector found in Data Studio. However, we had several sources that didn’t have quite the level of detail we needed in the native connector. This led us to use Data Transfer Service, which is a utility in BigQuery that will transfer data from Google owned and operated services. Hard to think of where they came up with the name, right? (More on that later).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*UAI2bce9-bHJTdC3gG_4Ug.png" /></figure><p>The Data Studio page to the left are similar to the pages we delivered at Gooogle, and were created with the Google Analytics connector in Data Studio using data collected on <a href="http://redpillanalytics.com">redpillanalytics.com</a>. Want to take a guess as to how much customization to the data source was needed to produce that report? 1 column. I created the “Returning Users” column logically from other available columns brought in by Google Analytics. We did similar pages for other data sets for Google, with minimal logical customization needed. Yes, some of the connectors to the Google products and data sets behind them really are that good.</p><h4>Plug-n-Play? Not Quite</h4><p>There are quite a few connectors available for Data Studio that natively connect to data sources. But how about if you have data that isn’t coming from one of those? Data Studio has the ability to bring in data from Google Sheets or more importantly, BigQuery. (For those of you unfamiliar with BigQuery you can read more <a href="https://cloud.google.com/bigquery/">here</a>.) We were able to get our hands on BigQuery’s Data Transfer Service, which allowed us to load data into a Google Cloud Project from serveral sources (Firebase, YouTube and AdWords to name a few).</p><p>When it came time to create visualizations on those data sets in BigQuery, we initially found that it was difficult to create visuals that told a coherent story, were filterable on the same prompts, and felt part of a cohesive whole. This is because Data Studio does not support joins between data sources (as I said before). This was somewhat surprising as there are other popular data visualization tools that allow this functionality. But I digress…</p><p>Being the resourceful guy that I am, I rolled up my sleeves, brushed off my SQL skills and started creating database, er, BigQuery views to handle the more complex logic that Data Studio couldn’t. Once the views were written, it was easy to connect Data Studio to them with the BigQuery connector and create visualizations.</p><h4>Asking the Right Questions</h4><p>Another thing that is notable about Data Studio is its pixel perfect nature. The ability to place anything anywhere on the canvas is so refreshing. Compared to preformatted, designated areas for reports and prompts, Data Studio exhibits a sense of freedom not usually experienced in data viz, BI or analytics tools.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*p0kdxFaqP1B0g0jLjqlnCg.png" /><figcaption><em>I guess it isn’t that bad…</em></figcaption></figure><p>Like any new found freedom, it can be hard to know what to do, and we often start causing trouble because we don’t know any better. To the left is what happens when you try to port the old world into the new one.</p><p>While the dashboard I created isn’t terrible, it doesn’t play to the strengths of the tool. And this is because of an old world mentality. The use of simple (and not helpful) titles, relying on the user to “figure it out” and overall, the lack of a story. These were common dashboard and reporting mistakes made with enterprise tools like OBIEE. Data Studio restricts the ability to make those mistakes with the freedom to structure as you see fit. And this freedom means that we need to ask questions. (Check out my <a href="https://blog.redpillanalytics.com/hunters-eat-better-than-gatherers-4484b548e2d4">blog</a> for more thoughts on that topic.)</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mqkccGzIIszvr8w3EES9BQ.png" /></figure><p>Let’s contrast my craft brewery report with the one to the left, which is an overview of Red Pill’s YouTube performance. Let’s start at the top and work our way down.</p><p>We can see some filter controls at the top: one for the date range, and one for the country code. I’ve worked at clients where there have been over 20 prompts on a dashboard. If you need so many filter controls, you don’t know what questions you’re asking.</p><p>Moving down a level, we can see we have some scorecards, which introduce the consumer to what we are talking about. Scorecards such as these can help set the tone and a frame of reference for more detailed visualizations. Additionally, the trending for these scorecards is as simple as defining the period of time we wanted to trend for. Defaults include last period (whatever the equivalent amount of time is selected for the report) or last year, but there are ways to customize as well. Think about how hard that would be in most other tools!</p><p>Finally, we get into the guts of the report page. You’ll notice that each visualization answers a question. You’ll also notice that we don’t have any tables in the report. While tables are fantastic for doing detailed analysis, being used as seed data for machine learning or statistical analysis, they look and act terribly on dashboards. Focusing our attention to answering questions and getting answers gives us a better output, and utilizes the tool as it should be.</p><h4>The Silent Cartographer</h4><p>Data Studio loves mapping data. Not only does it love it, it is good at it. Gone are the days of creating tedious map layers, curating geo data types and ensuring that lat-long values are correct. All that is required in Data Studio is setting data types correctly, which is incredibly simple.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*OCm8pUTEKd7KWnaQh3FdrQ.png" /></figure><p>You can see to the left is the drop down menu used for setting the geography type. Set the data type to the corresponding value set, and away you go! I’ve found that the code values correlate to geo ISO codes, and non-code values are names. The example to the left is from YouTube Analytics example we saw above.</p><h4>Sharing is Caring</h4><p>Another notable feature about Data Studio is its integration with Google Drive. This allows for easy sharing and collaboration with others. There are several options once you share, which will permit users to view, edit or become owners of the report. These permissions will also be inherited if the report is moved to a different folder; the users that have access to that folder will also have those permissions. Gone are the days of guessing which security groups a person is in or if that group has access to the report, because with Google Drive, it is pretty darn easy to know who has access to what.</p><p>One other thing to note is that data connectors are also stored in Google Drive, rather than being stored within the report. (However when a data connector is created, it is saved into the creator’s Google Drive home.) This means that the data connectors could be edited by multiple people and used within multiple reports. The same type of permission logic I talked about above is present here allowing for edits to be made by those with access to a Drive folder. Though it is worth noting that there is another level of nuance here. Data can be secured by setting a data source to query as the user (the default is to query as the owner) allowing for data level security to be implemented.</p><h4>Four Stars and Two Thumbs Up</h4><p>There is definitely some nuance that accompanies more complex data in Data Studio, but that is to be expected with any tool. Safe to say, I think that Data Studio is abound with awesome features, and I would be happy to use it with clients again.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f0cc856e556f" width="1" height="1"><hr><p><a href="https://blog.redpillanalytics.com/the-good-the-bad-and-the-gorgeous-f0cc856e556f">The Good, The Bad, and the Gorgeous</a> was originally published in <a href="https://blog.redpillanalytics.com">Red Pill Analytics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p> Phil Goerdt https://medium.com/p/f0cc856e556f Mon Nov 20 2017 10:30:12 GMT-0500 (EST) OAC - PBCS Connectivity http://beyond-just-data.blogspot.com/2017/11/oac-pbcs-connectivity.html <span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">I am not one to re-post Oracle Documentation or Oracle Readme's and pretend to make it my own.&nbsp; My intent for any of my blog posts is to extend the information provided or provide clarity.</span></span><br /><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><br /></span></span><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">The OAC 17.3.5 (August 2017) release extended connectivity to PBCS / EPBCS.</span></span><br /><br /><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">The configuration / setup instructions can be found here.&nbsp; <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/integrating-oracle-planning-and-budgeting.html" target="_blank">OAC PaaS Docs</a></span></span><br /><div class="MsoNormal"><br /></div><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">If you need to see pictures of this process you can do internet search for other blog posts that another person produced.</span></span><br /><br /><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">I followed each of these and when I attempted to connect and import metadata I received the following:</span></span><br /><br /><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><a href="https://4.bp.blogspot.com/-XvEPqSuYeN4/Wg8qxXxGKmI/AAAAAAAAMOs/66PqmAK3xhYb4sxmnaueaHZ1KcrsC4S1ACLcBGAs/s1600/Fail.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="588" data-original-width="894" height="262" src="https://4.bp.blogspot.com/-XvEPqSuYeN4/Wg8qxXxGKmI/AAAAAAAAMOs/66PqmAK3xhYb4sxmnaueaHZ1KcrsC4S1ACLcBGAs/s400/Fail.png" width="400" />&nbsp;</a></span></span></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">the NQSAdminTool.log file was not too helpful</span></span></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><a href="https://3.bp.blogspot.com/-d_Gh6J84vb8/Wg8ynrPOe2I/AAAAAAAAMO8/jxRWUJIXO6IRierINXOVMiZleB-xnUO1ACLcBGAs/s1600/log.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="348" data-original-width="1080" height="128" src="https://3.bp.blogspot.com/-d_Gh6J84vb8/Wg8ynrPOe2I/AAAAAAAAMO8/jxRWUJIXO6IRierINXOVMiZleB-xnUO1ACLcBGAs/s400/log.png" width="400" /></a></span></span></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><br /></span></span></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">However, I got to thinking; for the connectivity to Essbase Cloud I needed to open up ports on my Cloud Compute.&nbsp; I checked with my contact within my contact within Product Development and this was confirmed.</span></span></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><br /></span></span></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">So after logging into myCloudService and switching to the Compute Console / Network</span></span></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><br /></span></span></div><div class="separator" style="clear: both; text-align: center;"><a href="https://2.bp.blogspot.com/-PFYbt4q-mHE/Wg83xos8AuI/AAAAAAAAMPU/ByISo6EScMw_41dw1-wkvqzFRPA-Ikv8gCLcBGAs/s1600/MyCloudServices.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="181" data-original-width="756" height="95" src="https://2.bp.blogspot.com/-PFYbt4q-mHE/Wg83xos8AuI/AAAAAAAAMPU/ByISo6EScMw_41dw1-wkvqzFRPA-Ikv8gCLcBGAs/s400/MyCloudServices.png" width="400" /></a></div><br /><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"></span></span></div><br /><br /><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">I created a new Security Application with connectivity on port 9506</span></span></div><br /><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><br /></span></span></div><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"></span></span></div><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"></span></span></div><div style="text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><a href="https://4.bp.blogspot.com/-d4cveWXaseg/Wg8yskfyo6I/AAAAAAAAMPA/L3_q6W8U7JYEnNoTIReVSvh7P4WhiQtSgCLcBGAs/s1600/JavaHost1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="406" data-original-width="780" height="166" src="https://4.bp.blogspot.com/-d4cveWXaseg/Wg8yskfyo6I/AAAAAAAAMPA/L3_q6W8U7JYEnNoTIReVSvh7P4WhiQtSgCLcBGAs/s320/JavaHost1.png" width="320" /></a>&nbsp;</span></span></div><br /><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">Next<span style="color: #0000ee;"><u>,</u></span> I created a Security Rule with the Destination ANALYTICS/<i>instance</i>/ora_bi_infraadmin</span></span><br /><br /><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><a href="https://2.bp.blogspot.com/-iwU3m2j65S0/Wg8yu1x2cAI/AAAAAAAAMPE/YFbBhndX51we9KJfyjico-5y3HfZSgqLQCLcBGAs/s1600/2017-11-13_17-06-09.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="654" data-original-width="784" height="266" src="https://2.bp.blogspot.com/-iwU3m2j65S0/Wg8yu1x2cAI/AAAAAAAAMPE/YFbBhndX51we9KJfyjico-5y3HfZSgqLQCLcBGAs/s320/2017-11-13_17-06-09.png" width="320" /></a></span></span></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">Then back to my OAC Client Admin tool.&nbsp; I provided all the necessary connection information and Voila!&nbsp; I am able to import my EPBCS cubes into my RPD. </span></span></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><a href="https://3.bp.blogspot.com/-zA5u_6LdJgk/Wg8qxQ_t4OI/AAAAAAAAMOo/63FSFusdHXM46mgGhhEekqolEvMc3nz6QCLcBGAs/s1600/Success.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="588" data-original-width="893" height="262" src="https://3.bp.blogspot.com/-zA5u_6LdJgk/Wg8qxQ_t4OI/AAAAAAAAMOo/63FSFusdHXM46mgGhhEekqolEvMc3nz6QCLcBGAs/s400/Success.png" width="400" /></a></span></span></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;"><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;">&nbsp;Until next time! </span></span></div><div class="separator" style="clear: both; text-align: left;"><br /></div><span style="font-size: small;"><span style="font-family: &quot;arial&quot; , &quot;helvetica&quot; , sans-serif;"><br /></span></span><br /><br /> Wayne D. Van Sluys tag:blogger.com,1999:blog-7768091516190336427.post-5049716925672267060 Fri Nov 17 2017 14:33:00 GMT-0500 (EST) What’s EPRCS? Management Reporting from Oracle EPM, BI & ERP Data https://www.us-analytics.com/hyperionblog/enterprise-performance-reporting-cloud <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/enterprise-performance-reporting-cloud" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/Oracle%20EPRCS.jpg?t=1519157959954" alt="Oracle EPRCS.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>Finding a solution that allows for collaborative financial reporting that retains data integrity is an important goal for many organizations. It’s not a decision to take lightly, and you probably have a lot of questions about each tool you’re looking at.</p> <p>If you use Oracle EPM, BI, and/or ERP technology, you’re likely considering Oracle Enterprise Performance Reporting Cloud Service — a management and narrative reporting tool designed specifically for your Oracle systems.</p> <p>To help you decide if EPRCS is a good fit for you, we’ve covered frequently asked questions in this blog post. If you prefer video, skip straight to the <a href="https://www.us-analytics.com/video-oracle-enterprise-performance-reporting-cloud-service-eprcs">EPRCS demo</a> for a visual tour.</p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fenterprise-performance-reporting-cloud&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/enterprise-performance-reporting-cloud Fri Nov 17 2017 13:34:40 GMT-0500 (EST) Bulk Loading Zone https://blog.redpillanalytics.com/bulk-loading-zone-becac864cb12?source=rss----abcc62a8d63e---4 <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BnoWCI5PJP9qfuhCZ_SIHw.png" /></figure><p>Whether its an enterprise application, the automobile you drive, or <a href="https://www.theguardian.com/technology/2016/oct/12/english-man-spends-11-hours-trying-to-make-cup-of-tea-with-wi-fi-kettle">your favorite tea kettle</a>, seemingly everything in the world today produces data. This results in a need to transfer data to a place where people and technology can make sense of it. Typically, the faster data can be transferred and more data that can be stored in a centralized location, the better. One method of speeding up the data transfer process is to avoid running multiple insert statements and complete load tasks en masse, a function commonly referred to as bulk loading. <a href="https://streamsets.com/products/sdc/">StreamSets Data Collector</a> and <a href="https://www.snowflake.net/">Snowflake Data Warehouse</a> have emerged as front-runners for transferring and storing data, respectively, and conveniently work well together when bulk loading data.</p><p>Bulk loading data into Snowflake Data Warehouse is achieved using two basic commands: PUT and COPY INTO. Think of it like this: <em>put </em>the data somewhere Snowflake can see it and <em>copy </em>the data <em>into </em>Snowflake; pretty straightforward. As is often the case, these two commands support several options and can be made to be more complex but at their core, it is as simple as it sounds.</p><p>So where can Snowflake see the data? Answer: in an internal stage (user, table, or named) or an external stage, which amounts to any AWS S3 Bucket that Snowflake is given access to. With an internal stage, <a href="https://docs.snowflake.net/manuals/user-guide/snowsql.html">SnowSQL</a> or an equivalent client is used to upload files using the PUT command. Externally staged data files have a bit more freedom in that any technology that can ship files to S3 can be used. Enter StreamSets Data Collector.</p><p>StreamSets Data Collector (SDC) includes Amazon S3 as a destination (the PUT) and a JDBC Executor that can be called from the S3 destination using event framework, also called <em>triggers</em>,<em> </em>(the COPY INTO).</p><p>Focusing on externally staged data, the first step is to create an S3 bucket to be used for staging the data files. Red Pill Analytics already has a bucket for SDC prototyping in our account; that will do just fine.</p><p>Next, Snowflake needs access to read from the bucket; the following statement will create an external stage. <strong><em>Note</em></strong><em>: It is also possible to read straight from an S3 bucket without defining a stage. </em>This particular statement creates a stage called streamsets_test in the rpa_demo.publicschema.</p><pre>create stage rpa_demo.public.streamsets_test url = &#39;s3://&lt;bucket&gt;&#39; credentials = (aws_key_id = &#39;&lt;aws_key&gt;&#39; aws_secret_key = &#39;&lt;aws_secret_key&gt;&#39;);</pre><p>And then a table in the same database.schema to serve as the target. The pipeline will be configured to create JSON files so only one variant-type column is necessary:</p><p>create table rpa_demo.public.streamsets(v variant);</p><p>Lastly, a file format to facilitate loading JSON data rounds out the Snowflake setup:</p><pre>create file format rpa_demo.public.json type = &#39;JSON&#39; compression = &#39;auto&#39;;</pre><p>Now to configure the SDC pipeline. The source can be <a href="https://streamsets.com/connectors">any origin that StreamSets supports</a>. I’ve recently been working on an Oracle RDS database that contains TPC-DI data so I’ll run with that for now by using the JDBC Query Consumer. <strong>Important</strong>: To connect to a database via JDBC, the appropriate JDBC driver needs to exist or be added to the SDC external libraries. This remains true for loading data to Snowflake Data Warehouse.</p><p>A JDBC connection string and simple query using SDC syntax for incremental mode (if required) are all that is needed for this stage. This example will query data in the TRADE table:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5rQ0Wz_dLUGEVzqZ--RJGQ.png" /></figure><p>Any of the SDC processors can be used to perform additional data processing at this point but rather than adding complexity, going straight from source to target will help keep it simple. With that said, the next step is to add the Amazon S3 destination using the same bucket that was created as a Snowflake external stage. The S3 destination needs a bucket name and its corresponding keys:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*q8p0OeW6f1Jh-znQrzcqxA.png" /></figure><p>Triggers are enabled by simply checking the box labeled <em>Produce Events</em> on the S3 destination:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*OseLUhhnWJhm5LY_Zb_2Xg.png" /></figure><p>The JDBC Executor is now able to be called after data files are written to S3. By placing the SQL statement below in the JDBC Executor <em>SQL Query</em> configuration, only the statement (not the data) will be issued to Snowflake via a JDBC call. Snowflake will then handle the connection back to the S3 bucket based on the setup/configurations above and bulk load the data into the specified destination; in this case,rpa_demo.public.streamsets.</p><pre>copy into rpa_demo.public.streamsets<br> from @streamsets_test<br> file_format = &#39;json&#39;;</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_j3jAfeN5834jjg9Neqr-Q.png" /></figure><p>The pipeline is ready to go. On your mark, get set, start the pipeline! As expected, SDC has created a .json file in S3…</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*1gtIh5p6EZDX2mBtI6d5eA.png" /></figure><p>…and the data has been copied into Snowflake.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*nrR9J1UmMGOa-moah1NnsA.png" /></figure><p>Success!</p><p>As an aside — SDC also provides a JDBC Producer destination which can be used to load Snowflake and is sufficient in many, usually smaller scale, use cases. The JDBC Producer loads records using insert statements with bind variables; use PUT/COPY INTO when bulk loading is desirable.</p><p>Be sure to check back for follow-up blogs on how to enhance the basic process outlined in this post.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=becac864cb12" width="1" height="1"><hr><p><a href="https://blog.redpillanalytics.com/bulk-loading-zone-becac864cb12">Bulk Loading Zone</a> was originally published in <a href="https://blog.redpillanalytics.com">Red Pill Analytics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p> Mike Fuller https://medium.com/p/becac864cb12 Fri Nov 17 2017 10:40:14 GMT-0500 (EST) Allies: Oracle Data Miner, Data Visualization, and R Enterprise https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/ <p>Phew, it’s been a looong time since I last blogged. The frequency of my blogs is inversely related to my workload, so suffice it to say that there are lots of people interested in BI, Data Visualization, and Advanced Analytics right now!</p> <p>I have had a blog post brewing in my head about all the new features of Data Visualization Desktop 4.0, but instead of showing you all the new and additional features (like everyone is doing now, therefore adding zero collective value), I want to show you how I’m demoing some of the new features using a full analytics stack, not just DV. The various advanced analytics options <em>complement </em>each other, not replace each other!</p> <p><strong>Background</strong></p> <p>A topic that is coming up more frequently with customers is Advanced Analytics in Oracle, specifically around R, an open source statistics programming language and software environment. I was first introduced to R in college during my capstone statistics classes but never used it post-undergrad. In grad school, we were taught to use SPSS, but by then I had already been “real-world” programming for a few years and found it easier to code my own stats programs versus learning someone else’s. …But I still had R as a base.</p> <p>I’ve really been excited about the opportunity to relearn R for showing customers Oracle’s strength in the advanced analytics arena using R. This includes Oracle R Enterprise, Advanced Analytics in the Oracle database, Advanced Analytics in Oracle Business Intelligence, and Advanced Analytics &amp; R in Data Visualization. …Yep, I finally get to use my R and statistics skills nearly 20 years after I learned them. Okay, I’ve re-learned them.</p> <p>A flow that I recently presented was one using Oracle Data Miner (via the tutorial example) to filter out the insurance customers with the greatest LTV. I won’t go into too many details on this piece as I want to dedicate a blog or two to this tool on its own.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image001.jpg"><img data-attachment-id="1863" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image001-12/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image001.jpg?w=840" data-orig-size="624,317" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image001" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image001.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image001.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image001.jpg?w=840" alt="" class="alignnone size-full wp-image-1863" srcset="https://epmqueen.files.wordpress.com/2017/11/image001.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image001.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image001.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>I am using the example from Oracle Data Miner that shows the flow in SQL*Developer to identify the best LTV (long term value) of customers. If you haven’t already gone through the tutorial for installing and creating flows in Data Miner, I highly recommend taking the hour or so to learn the process.</p> <p>A table that is part of this process is called “INSUR_CUST_LTV_SAMPLE”.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image002.png"><img data-attachment-id="1864" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image002-9/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image002.png?w=840" data-orig-size="265,156" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image002" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image002.png?w=840?w=265" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image002.png?w=840?w=265" src="https://epmqueen.files.wordpress.com/2017/11/image002.png?w=840" alt="" class="alignnone size-full wp-image-1864" srcset="https://epmqueen.files.wordpress.com/2017/11/image002.png 265w, https://epmqueen.files.wordpress.com/2017/11/image002.png?w=150 150w" sizes="(max-width: 265px) 100vw, 265px" /></a></p> <p>This has proven to be a fun set of data to work with, and also real-world applicable. Before heading to ORE, let’s take a look at some fun with the data in DVD 4.0.</p> <p>First things first…</p> <ol start="1"> <li>Create the Connection in DVD<br /> <a href="https://epmqueen.files.wordpress.com/2017/11/image003.jpg"><img data-attachment-id="1865" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image003-10/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image003.jpg?w=840" data-orig-size="624,494" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image003" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image003.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image003.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image003.jpg?w=840" alt="" class="alignnone size-full wp-image-1865" srcset="https://epmqueen.files.wordpress.com/2017/11/image003.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image003.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image003.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> </li> <li>Create the Data Set to use from the Connection and connect to “INSUR_CUST_LTV_SAMPLE”.<br /> <a href="https://epmqueen.files.wordpress.com/2017/11/image004.jpg"><img data-attachment-id="1866" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image004-10/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image004.jpg?w=840" data-orig-size="624,140" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image004" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image004.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image004.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image004.jpg?w=840" alt="" class="alignnone size-full wp-image-1866" srcset="https://epmqueen.files.wordpress.com/2017/11/image004.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image004.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image004.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> </li> <li>Create a new project with the new Data Set. From here, you can create whatever your mind can imagine or wonder.<br /> <a href="https://epmqueen.files.wordpress.com/2017/11/image005.jpg"><img data-attachment-id="1867" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image005-12/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image005.jpg?w=840" data-orig-size="625,298" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image005" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image005.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image005.jpg?w=840?w=625" src="https://epmqueen.files.wordpress.com/2017/11/image005.jpg?w=840" alt="" class="alignnone size-full wp-image-1867" srcset="https://epmqueen.files.wordpress.com/2017/11/image005.jpg 625w, https://epmqueen.files.wordpress.com/2017/11/image005.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image005.jpg?w=300 300w" sizes="(max-width: 625px) 100vw, 625px" /></a></p> </li> </ol> <p>One piece I’ve really enjoyed in 4.0 (not to get ahead of myself), is the “Explain” function. You can choose any Attribute in your data element list and see how that attribute correlates to other attributes and facts or find anomalies in your data. Basically, DVD goes through a series of R and Python scripts to teach you about your own data. Sidebar: If you are curious about the different R and Python scripts available to you in DVD, go to the following folder and see for yourself:</p> <p>R:</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image006.jpg"><img data-attachment-id="1868" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image006-11/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image006.jpg?w=840" data-orig-size="624,449" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image006" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image006.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image006.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image006.jpg?w=840" alt="" class="alignnone size-full wp-image-1868" srcset="https://epmqueen.files.wordpress.com/2017/11/image006.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image006.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image006.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Python:</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image007.jpg"><img data-attachment-id="1869" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image007-9/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image007.jpg?w=840" data-orig-size="624,348" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image007" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image007.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image007.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image007.jpg?w=840" alt="" class="alignnone size-full wp-image-1869" srcset="https://epmqueen.files.wordpress.com/2017/11/image007.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image007.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image007.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>When I ran “Explain” on “SEX” (right-clicking on “Sex” and choosing “Explain SEX”</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image008.png"><img data-attachment-id="1870" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image008-12/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image008.png?w=840" data-orig-size="312,227" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image008" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image008.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image008.png?w=840?w=312" src="https://epmqueen.files.wordpress.com/2017/11/image008.png?w=840" alt="" class="alignnone size-full wp-image-1870" srcset="https://epmqueen.files.wordpress.com/2017/11/image008.png 312w, https://epmqueen.files.wordpress.com/2017/11/image008.png?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image008.png?w=300 300w" sizes="(max-width: 312px) 100vw, 312px" /></a></p> <p>I get many different panes of information. Here are a few:</p> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image009-12/'><img width="150" height="90" src="https://epmqueen.files.wordpress.com/2017/11/image009.jpg?w=150&#038;h=90" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image009.jpg?w=150&#038;h=90 150w, https://epmqueen.files.wordpress.com/2017/11/image009.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1871" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image009-12/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image009.jpg" data-orig-size="624,375" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image009" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image009.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image009.jpg?w=624" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image010-10/'><img width="150" height="90" src="https://epmqueen.files.wordpress.com/2017/11/image010.jpg?w=150&#038;h=90" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image010.jpg?w=150&#038;h=90 150w, https://epmqueen.files.wordpress.com/2017/11/image010.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1872" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image010-10/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image010.jpg" data-orig-size="624,373" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image010" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image010.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image010.jpg?w=624" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image011-11/'><img width="150" height="90" src="https://epmqueen.files.wordpress.com/2017/11/image011.jpg?w=150&#038;h=90" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image011.jpg?w=150&#038;h=90 150w, https://epmqueen.files.wordpress.com/2017/11/image011.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1873" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image011-11/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image011.jpg" data-orig-size="623,374" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image011" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image011.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image011.jpg?w=623" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image012-10/'><img width="150" height="90" src="https://epmqueen.files.wordpress.com/2017/11/image012.jpg?w=150&#038;h=90" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image012.jpg?w=150&#038;h=90 150w, https://epmqueen.files.wordpress.com/2017/11/image012.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1874" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image012-10/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image012.jpg" data-orig-size="624,374" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image012" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image012.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image012.jpg?w=624" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image013-10/'><img width="150" height="90" src="https://epmqueen.files.wordpress.com/2017/11/image013.jpg?w=150&#038;h=90" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image013.jpg?w=150&#038;h=90 150w, https://epmqueen.files.wordpress.com/2017/11/image013.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1875" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image013-10/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image013.jpg" data-orig-size="623,373" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image013" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image013.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image013.jpg?w=623" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image014-10/'><img width="150" height="91" src="https://epmqueen.files.wordpress.com/2017/11/image014.jpg?w=150&#038;h=91" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image014.jpg?w=150&#038;h=91 150w, https://epmqueen.files.wordpress.com/2017/11/image014.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1876" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image014-10/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image014.jpg" data-orig-size="624,377" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image014" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image014.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image014.jpg?w=624" /></a> <p>And then, you can take these visualizations and use them immediately in your project.</p> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image015-7/'><img width="150" height="90" src="https://epmqueen.files.wordpress.com/2017/11/image015.jpg?w=150&#038;h=90" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image015.jpg?w=150&#038;h=90 150w, https://epmqueen.files.wordpress.com/2017/11/image015.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1877" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image015-7/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image015.jpg" data-orig-size="625,376" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image015" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image015.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image015.jpg?w=625" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image016-9/'><img width="150" height="69" src="https://epmqueen.files.wordpress.com/2017/11/image016.jpg?w=150&#038;h=69" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image016.jpg?w=150&#038;h=69 150w, https://epmqueen.files.wordpress.com/2017/11/image016.jpg?w=298 298w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1878" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image016-9/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image016.jpg" data-orig-size="625,289" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image016" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image016.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image016.jpg?w=625" /></a> <p>So…enough with DVD. Let’s move to ORE…</p> <p>Oracle R Enterprise allows you to connect to Oracle databases via the R interface. This can be done via RStudio or by invoking R via the command line.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image017.jpg"><img data-attachment-id="1879" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image017-6/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image017.jpg?w=840" data-orig-size="624,436" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image017" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image017.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image017.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image017.jpg?w=840" alt="" class="alignnone size-full wp-image-1879" srcset="https://epmqueen.files.wordpress.com/2017/11/image017.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image017.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image017.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>To use ORE, we need to invoke the ORE library.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image018.jpg"><img data-attachment-id="1880" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image018-7/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image018.jpg?w=840" data-orig-size="624,439" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image018" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image018.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image018.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image018.jpg?w=840" alt="" class="alignnone size-full wp-image-1880" srcset="https://epmqueen.files.wordpress.com/2017/11/image018.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image018.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image018.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>The first thing we need to do is connect to the database. <a href="https://epmqueen.files.wordpress.com/2017/11/image019.jpg"><img data-attachment-id="1881" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image019-7/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image019.jpg?w=840" data-orig-size="624,440" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image019" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image019.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image019.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image019.jpg?w=840" alt="" class="alignnone size-full wp-image-1881" srcset="https://epmqueen.files.wordpress.com/2017/11/image019.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image019.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image019.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>From the built in R datasets, let’s create a table in our Oracle database. Let’s choose ‘airquality’.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image020.jpg"><img data-attachment-id="1882" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image020-8/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image020.jpg?w=840" data-orig-size="624,437" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image020" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image020.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image020.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image020.jpg?w=840" alt="" class="alignnone size-full wp-image-1882" srcset="https://epmqueen.files.wordpress.com/2017/11/image020.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image020.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image020.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>We aren’t limited to just datasets. We can create random datasets to send to the database. Here, we are creating a data frame in which the x values are 1-5 and the y values are a-e.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image021.jpg"><img data-attachment-id="1883" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image021-8/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image021.jpg?w=840" data-orig-size="624,438" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image021" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image021.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image021.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image021.jpg?w=840" alt="" class="alignnone size-full wp-image-1883" srcset="https://epmqueen.files.wordpress.com/2017/11/image021.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image021.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image021.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Next, let’s create another data frame with different, but similar parameters.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image022.png"><img data-attachment-id="1884" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image022-6/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image022.png?w=840" data-orig-size="657,465" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image022" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image022.png?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image022.png?w=840?w=657" src="https://epmqueen.files.wordpress.com/2017/11/image022.png?w=840" alt="" class="alignnone size-full wp-image-1884" srcset="https://epmqueen.files.wordpress.com/2017/11/image022.png 657w, https://epmqueen.files.wordpress.com/2017/11/image022.png?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image022.png?w=300 300w" sizes="(max-width: 657px) 100vw, 657px" /></a></p> <p>Let’s create a table with the data frames we have created from thin air.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image023.jpg"><img data-attachment-id="1885" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image023-6/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image023.jpg?w=840" data-orig-size="624,441" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image023" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image023.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image023.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image023.jpg?w=840" alt="" class="alignnone size-full wp-image-1885" srcset="https://epmqueen.files.wordpress.com/2017/11/image023.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image023.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image023.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Let’s see the list of all of our database tables from R:</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image024.jpg"><img data-attachment-id="1886" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image024-6/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image024.jpg?w=840" data-orig-size="624,436" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image024" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image024.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image024.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image024.jpg?w=840" alt="" class="alignnone size-full wp-image-1886" srcset="https://epmqueen.files.wordpress.com/2017/11/image024.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image024.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image024.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>AIRQUALITY, DF1, and DF2. Exactly what we would expect.</p> <p>Let’s see what’s in the R list:</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image025.jpg"><img data-attachment-id="1887" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image025-7/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image025.jpg?w=840" data-orig-size="624,440" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image025" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image025.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image025.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image025.jpg?w=840" alt="" class="alignnone size-full wp-image-1887" srcset="https://epmqueen.files.wordpress.com/2017/11/image025.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image025.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image025.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>Since we did not add “airquality” to our R list, it doesn’t show.</p> <p>Let’s save our “airquality” to our lists. Note that it was already there for me, so I got an “error”.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image026.jpg"><img data-attachment-id="1888" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image026-7/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image026.jpg?w=840" data-orig-size="624,437" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image026" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image026.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image026.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image026.jpg?w=840" alt="" class="alignnone size-full wp-image-1888" srcset="https://epmqueen.files.wordpress.com/2017/11/image026.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image026.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image026.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>To show the proof that R is working with the Oracle database, here are our listings in SQL*Developer.</p> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image027-6/'><img width="150" height="114" src="https://epmqueen.files.wordpress.com/2017/11/image027.png?w=150&#038;h=114" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image027.png?w=150&#038;h=114 150w, https://epmqueen.files.wordpress.com/2017/11/image027.png?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1889" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image027-6/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image027.png" data-orig-size="630,477" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image027" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image027.png?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image027.png?w=630" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image028-7/'><img width="150" height="135" src="https://epmqueen.files.wordpress.com/2017/11/image028.png?w=150&#038;h=135" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image028.png?w=150&#038;h=135 150w, https://epmqueen.files.wordpress.com/2017/11/image028.png?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1890" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image028-7/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image028.png" data-orig-size="450,404" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image028" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image028.png?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image028.png?w=450" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image029-4/'><img width="150" height="132" src="https://epmqueen.files.wordpress.com/2017/11/image029.png?w=150&#038;h=132" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image029.png?w=150&#038;h=132 150w, https://epmqueen.files.wordpress.com/2017/11/image029.png?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1891" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image029-4/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image029.png" data-orig-size="427,377" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image029" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image029.png?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image029.png?w=427" /></a> <a href='https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image030-3/'><img width="150" height="38" src="https://epmqueen.files.wordpress.com/2017/11/image030.jpg?w=150&#038;h=38" class="attachment-thumbnail size-thumbnail" alt="" srcset="https://epmqueen.files.wordpress.com/2017/11/image030.jpg?w=150&#038;h=38 150w, https://epmqueen.files.wordpress.com/2017/11/image030.jpg?w=300 300w" sizes="(max-width: 150px) 100vw, 150px" data-attachment-id="1892" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image030-3/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image030.jpg" data-orig-size="624,157" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image030" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image030.jpg?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image030.jpg?w=624" /></a> <p>To show we can also do “R” things, here is an example of a summary of our data store.</p> <p><a href="https://epmqueen.files.wordpress.com/2017/11/image031.jpg"><img data-attachment-id="1893" data-permalink="https://realtrigeek.com/2017/11/16/allies-oracle-data-miner-data-visualization-and-r-enterprise/image031-3/" data-orig-file="https://epmqueen.files.wordpress.com/2017/11/image031.jpg?w=840" data-orig-size="624,437" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image031" data-image-description="" data-medium-file="https://epmqueen.files.wordpress.com/2017/11/image031.jpg?w=840?w=300" data-large-file="https://epmqueen.files.wordpress.com/2017/11/image031.jpg?w=840?w=624" src="https://epmqueen.files.wordpress.com/2017/11/image031.jpg?w=840" alt="" class="alignnone size-full wp-image-1893" srcset="https://epmqueen.files.wordpress.com/2017/11/image031.jpg 624w, https://epmqueen.files.wordpress.com/2017/11/image031.jpg?w=150 150w, https://epmqueen.files.wordpress.com/2017/11/image031.jpg?w=300 300w" sizes="(max-width: 624px) 100vw, 624px" /></a></p> <p>So there’s the quick and dirty on how you can tie together Data Miner, Data Visualization, and ORE. These Advanced Analytics are not “or” decisions, they are easily “and” decisions!</p> Sarah Craynon Zumbrum http://realtrigeek.com/?p=1862 Thu Nov 16 2017 20:07:08 GMT-0500 (EST) DEVEPM on Oracle Magazine https://devepm.com/2017/11/16/devepm-on-oracle-magazine/ Hi all! Very quick post today! Rodrigo was interviewed by Oracle Magazine for the November/December issue. Check it out! DEVEPM on Oracle Magazine Thanks! radk00 http://devepm.com/?p=1701 Thu Nov 16 2017 10:44:23 GMT-0500 (EST) How to Implement Transparent Data Encryption (TDE) in an Oracle Database http://blog.performancearchitects.com/wp/2017/11/15/how-to-implement-transparent-data-encryption-tde-in-an-oracle-database/ <p>Author: Cameron Ross, Performance Architects</p> <p>The reason for using <a href="http://www.oracle.com/technetwork/database/security/tde-faq-093689.html">Oracle Transparent Data Encryption Oracle (TDE)</a> column encryption is to protect confidential data, such as credit card and social security numbers, stored in table columns. TDE column encryption encrypts and decrypts data transparently when data passes through the SQL layer with no modification required to any existing application.</p> <p>The first step to implementing Oracle TDE is to create a wallet file location that will store all of the encryption key information. Below is a screenshot after manually creating the “orcl_wallet” folder in the file directory on the machine where the Oracle database is installed:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-1.png"><img class="alignnone size-medium wp-image-2174" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-1-300x157.png" alt="" width="300" height="157" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-1-300x157.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-1-768x402.png 768w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-1-624x326.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-1.png 855w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>The next step is to specify the location of the wallet in the “sqlnet.ora” file, located in the “NETWORK/admin” folder.</p> <ul> <li>ENCRYPTION_WALLET_LOCATION =(SOURCE =(METHOD = FILE)(METHOD_DATA =(DIRECTORY = ’file location’)))</li> </ul> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-2.png"><img class="alignnone size-medium wp-image-2173" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-2-300x113.png" alt="" width="300" height="113" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-2-300x113.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-2-768x290.png 768w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-2-624x235.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-2.png 954w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>Then, open up a command window and connect to “sqlplus” using the “sys” as an “sysdba” account.   As an alternative, a user assigned the “SYSKM” privilege also login.</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-3.png"><img class="alignnone size-medium wp-image-2172" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-3-300x159.png" alt="" width="300" height="159" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-3-300x159.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-3-624x330.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-3.png 679w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>After logging into “sqlplus,” execute the following commands to create, open, and set the master key:</p> <ul> <li>ADMINISTER KEY MANAGEMENT CREATE KEYSTORE ‘file location’ IDENTIFIED BY ‘password’; <ul> <li>This command creates the keystore file in the location that was inserted into the sqlnet.ora file</li> </ul> </li> <li>ADMINISTER KEY MANAGEMENT SET KEYSTORE OPEN IDENTIFIED BY ‘password’; <ul> <li>This command opens the keystore to enable encrypting columns or tablespaces</li> </ul> </li> <li>ADMINISTER KEY MANAGEMENT SET KEY IDENTIFIED BY ‘password’ WITH BACKUP; <ul> <li>This command sets up the master key that controls all of the keys that are used to encrypt specific columns</li> </ul> </li> </ul> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-4.png"><img class="alignnone size-medium wp-image-2171" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-4-300x164.png" alt="" width="300" height="164" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-4-300x164.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-4-624x342.png 624w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-4.png 676w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>Query “V_$ENCRYPTION_WALLET” to ensure that the “STATUS” column is set to “OPEN” and that the “WALLET_TYPE” column is set to “PASSWORD.” This ensures that the wallet has been set up correctly and is open.</p> <p>One advanced feature of TDE is being able to set the wallet for auto-login. This opens the wallet and key store automatically whenever the database is started.   If auto-login is not enabled, commands to open the key store must be executed each time the database is started.</p> <p>To enable auto-login, enter the following statements:</p> <ul> <li>ADMINISTER KEY MANAGEMENT CREATE AUTO_LOGIN KEYSTORE FROM KEYSTORE ‘file location’ IDENTIFIED BY ‘password’;</li> <li>After entering the “Create Auto Login” command, use the “Startup Force” command to restart the database instance. The reason to restart the database instance is so that it can switch the wallet type from “password” to “auto-login.”</li> </ul> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-5.png"><img class="alignnone size-medium wp-image-2170" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-5-300x162.png" alt="" width="300" height="162" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-5-300x162.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-5.png 418w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>To ensure that the auto-login is set to “Wallet,” log in to the database via any SQL querying tool and query the “V_$ENCRYPTION_WALLET” table. Ensure that your “WALLET_TYPE” column is set to “AUTOLOGIN” and that the “STATUS” column is set to “OPEN.”</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-6.png"><img class="alignnone size-medium wp-image-2169" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-6-300x120.png" alt="" width="300" height="120" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-6-300x120.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/cam-6.png 609w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>&nbsp;</p> Melanie Mathews http://blog.performancearchitects.com/wp/?p=2168 Wed Nov 15 2017 05:16:30 GMT-0500 (EST) UPDATE: OAC - Import Essbase Cloud to OAC-BI Admin Tool http://beyond-just-data.blogspot.com/2017/11/update-oac-import-essbase-cloud-to-oac.html <span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">In my post <a class="OAVLIQC-c-g" href="https://www.blogger.com/blogger.g?blogID=7768091516190336427#editor/target=post;postID=3314267337444036097;onPublishedMenu=template;onClosedMenu=template;postNum=7;src=postname">OAC - Import Essbase Cloud to OAC-BI Admin Tool </a></span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">I shared that the Essbase 11.1.2.3.500 Database Type does not work for importing Essbase metadata and that you needed to use the Essbase 9 type the switch back to Essbase 11.1.2.3.500 in order to pass the consistency check.</span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">Well I opened an SR and was told that this fixed in the OAC 17.4.1 patch and related BI Admin Tool.&nbsp;&nbsp;</span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">So I have updated my Database Type in my Essbase Connection</span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><a href="https://4.bp.blogspot.com/-AiZ2-r3NQCQ/WgoujpjjtoI/AAAAAAAAMOM/2DfDMOengVwdihVWcBbi_G3kYux_gcNfQCLcBGAs/s1600/bad.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="324" data-original-width="571" height="226" src="https://4.bp.blogspot.com/-AiZ2-r3NQCQ/WgoujpjjtoI/AAAAAAAAMOM/2DfDMOengVwdihVWcBbi_G3kYux_gcNfQCLcBGAs/s400/bad.png" width="400" /></a></span></span></div><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">And when I attempted to import metadata I still get the error.</span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">&nbsp;</span></span><br /><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><a href="https://1.bp.blogspot.com/--t0luYQ8oxs/WgoujXFrnqI/AAAAAAAAMOI/4uXKkq5WrgkTtr6sFxsaS08HmtgfFMW9wCLcBGAs/s1600/Fail.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="430" data-original-width="982" height="175" src="https://1.bp.blogspot.com/--t0luYQ8oxs/WgoujXFrnqI/AAAAAAAAMOI/4uXKkq5WrgkTtr6sFxsaS08HmtgfFMW9wCLcBGAs/s400/Fail.png" width="400" /></a></span></span></div><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">Since i am in the test mode I figured I would see if the Essbase 11 database type worked.</span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">&nbsp;</span></span><br /><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><a href="https://4.bp.blogspot.com/-pzTp_39Grfo/WgoujP6DuHI/AAAAAAAAMOA/I7p0ZxcxBfE6XkmH2K_wflpOJqL3pNbjgCLcBGAs/s1600/Good.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="535" data-original-width="574" height="372" src="https://4.bp.blogspot.com/-pzTp_39Grfo/WgoujP6DuHI/AAAAAAAAMOA/I7p0ZxcxBfE6XkmH2K_wflpOJqL3pNbjgCLcBGAs/s400/Good.png" width="400" /></a></span></span></div><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">&nbsp;And... low and behold it does.</span></span><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><div class="separator" style="clear: both; text-align: center;"><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><a href="https://4.bp.blogspot.com/-hA7JksTk5zk/WgoujWM--II/AAAAAAAAMOE/u2YCfIjS_RsBKc-LesuEw9-gtYjeasf2gCLcBGAs/s1600/Success.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="680" data-original-width="987" height="275" src="https://4.bp.blogspot.com/-hA7JksTk5zk/WgoujWM--II/AAAAAAAAMOE/u2YCfIjS_RsBKc-LesuEw9-gtYjeasf2gCLcBGAs/s400/Success.png" width="400" /></a></span></span></div><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;"><br /></span></span><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">Now I no longer need to switch the Database Type to 9 then to 11.1.2.3.500 each time I need to import metadata.&nbsp; And I can leave the Database Type set to Essbase 11 and it will pass consistency check. </span></span><br /><br /><span style="font-size: small;"><span style="font-family: Arial,Helvetica,sans-serif;">Until next time.</span></span> Wayne D. Van Sluys tag:blogger.com,1999:blog-7768091516190336427.post-1648846484093790828 Mon Nov 13 2017 18:54:00 GMT-0500 (EST) Upgrading Hyperion Soon? Document These 4 Things https://www.us-analytics.com/hyperionblog/upgrading-hyperion-soon-document-these-4-things <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/upgrading-hyperion-soon-document-these-4-things" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/Upgrade%20Hyperion%20Soon%20-%20Document%20these%204%20things.jpg?t=1519157959954" alt="Upgrading Hyperion Soon? Document These 4 Things" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><br>There are many reasons for having to upgrade your Oracle EPM enterprise software, including:</p> <ul> <li>Compatibility with new operating systems</li> <li>New features or functionality that could benefit your business</li> <li>Support from Oracle if your current version is falling off support and maintenance</li> <li>Mergers, acquisitions, chart of account restructures, and consolidation of multiple systems</li> </ul> <p>No matter your reason for upgrading, documentation should be a priority. Good documentation paves the way for a smooth transition and successful migration.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fupgrading-hyperion-soon-document-these-4-things&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/upgrading-hyperion-soon-document-these-4-things Fri Nov 10 2017 06:11:00 GMT-0500 (EST) What’s New in Oracle Data Visualization? (Update on V4 Desktop Version) https://www.us-analytics.com/hyperionblog/oracle-data-visualization-v4 <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/oracle-data-visualization-v4" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/oracle%20data%20visualization%20v4.jpg?t=1519157959954" alt="oracle data visualization v4.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>The recent release of <a href="https://www.us-analytics.com/hyperionblog/oracle-analytics-cloud-questions">Oracle Analytics Cloud (OAC)</a> V4 comes with many changes to Oracle Data Visualization (DV) Desktop version.&nbsp; The latest version of DV expands upon the current features — visual data storytelling, end user self-service, and mobile accessibility — to give you an even better user experience.</p> <p>In this blog post we’ll give you an overview of several new features made to…</p> <ul> <li>Your Homepage</li> <li>Data actions</li> <li>The storytelling interface</li> <li>Data flows<br><br></li> </ul> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Foracle-data-visualization-v4&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/oracle-data-visualization-v4 Thu Nov 09 2017 13:46:43 GMT-0500 (EST) Modernizing an Outdated Financial Close Process https://www.us-analytics.com/hyperionblog/modernizing-an-outdated-financial-close-process <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/modernizing-an-outdated-financial-close-process" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/Modern%20finance.jpg?t=1519157959954" alt="Modernizing an Outdated Financial Close Process" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p><br>When you hear “A.B.C.: Always Be Closing!” — you probably think of an angry Alec Baldwin in <em>Glengarry Glen Ross</em> yelling at a room of real estate agents. It’s the motto of salespeople, but it completely applies to the world of accounting, if you think of it in terms of financial close.</p> <p>A continuous, or extended, financial close is where we’re headed. Though this might be the most important part of the modern financial close, other aspects include automating time-consuming manual tasks and delivering high value and reduced cycle times.</p> <p>In this blog post, we’ll address each aspect of a modern <a href="https://www.us-analytics.com/solutions/financial-close-consolidation">financial close</a>, starting with a continuous financial close cycle.</p> <h3></h3> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fmodernizing-an-outdated-financial-close-process&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/modernizing-an-outdated-financial-close-process Thu Nov 09 2017 12:07:00 GMT-0500 (EST) ODTUG Kscope18 Update #2 http://www.odtug.com/p/bl/et/blogaid=751&source=1 Opal Alapat, the ODTUG Kscope18 Conference Chair, shares some updates about ODTUG Kscope18. ODTUG http://www.odtug.com/p/bl/et/blogaid=751&source=1 Wed Nov 08 2017 12:48:46 GMT-0500 (EST) ODTUG Kscope18 Update #2 http://kscope18.odtug.com/p/bl/et/blogaid=751&source=1 Opal Alapat, the ODTUG Kscope18 Conference Chair, shares some updates about ODTUG Kscope18. ODTUG http://kscope18.odtug.com/p/bl/et/blogaid=751&source=1 Wed Nov 08 2017 12:48:46 GMT-0500 (EST) Renaming Presentation Tables in OBIEE 12c http://blog.performancearchitects.com/wp/2017/11/08/renaming-presentation-tables-in-obiee-12c/ <p>Author: Linda Stewart, Performance Architects</p> <p>Today I was working in an <a href="http://www.oracle.com/technetwork/middleware/bi-enterprise-edition/overview/index.html">Oracle Business Intelligence Enterprise Edition (OBIEE) 12c</a> RPD (Version 12.2.1.2, the on-premise Oracle BI solution) and I dragged my table from the logical level to the presentation level.  I wanted to rename the table, but the name in the property sheet was locked.</p> <p>The solution is to set a property in the “Tools &gt; Option &gt; General” tab.</p> <p>Let’s walk through the solution:</p> <p>My logical table object is: “Fact_PC_Reconciliation_Extension” and I want the presentation table object name to be: “Fact &#8211; PC Reconciliation Report.”</p> <p>If I go to the presentation layer and right-click my table, I then can select “Properties” from the menu:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS1.png"><img class="alignnone size-medium wp-image-2184" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS1-159x300.png" alt="" width="159" height="300" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS1-159x300.png 159w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS1.png 205w" sizes="(max-width: 159px) 100vw, 159px" /></a></p> <p>The property sheet has the “Name” value greyed out and it cannot be edited:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS2.png"><img class="alignnone size-medium wp-image-2183" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS2-300x294.png" alt="" width="300" height="294" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS2-300x294.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS2.png 602w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>To fix this, click “Tools &gt; Options” and then in the “General” tab, check “Edit presentation names” and click “OK:”</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS3.png"><img class="alignnone size-medium wp-image-2182" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS3-255x300.png" alt="" width="255" height="300" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS3-255x300.png 255w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS3.png 359w" sizes="(max-width: 255px) 100vw, 255px" /></a></p> <p>Reopen the menu for the table by right clicking on “Presentation Table name”:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS4.png"><img class="alignnone size-medium wp-image-2181" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS4-145x300.png" alt="" width="145" height="300" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS4-145x300.png 145w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS4.png 205w" sizes="(max-width: 145px) 100vw, 145px" /></a></p> <p>Notice that we now have two new menu options: “Rename Wizard” and “Rename.”  Open “Properties:”</p> <p>The value for “Name” is now unlocked and we can rename the “Presentation Table.”</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS5.png"><img class="alignnone size-medium wp-image-2180" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS5-300x294.png" alt="" width="300" height="294" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS5-300x294.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS5.png 609w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>After renaming:</p> <p><a href="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS6.png"><img class="alignnone size-medium wp-image-2179" src="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS6-300x196.png" alt="" width="300" height="196" srcset="http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS6-300x196.png 300w, http://blog.performancearchitects.com/wp/wp-content/uploads/2017/10/LS6.png 588w" sizes="(max-width: 300px) 100vw, 300px" /></a></p> <p>I hope this blog might save some others some time when working in the RPD.</p> Melanie Mathews http://blog.performancearchitects.com/wp/?p=2178 Wed Nov 08 2017 05:59:00 GMT-0500 (EST) Getting Started with Strategic Modeling in EPBCS https://www.us-analytics.com/hyperionblog/strategic-modeling-with-epbcs <div class="hs-featured-image-wrapper"> <a href="https://www.us-analytics.com/hyperionblog/strategic-modeling-with-epbcs" title="" class="hs-featured-image-link"> <img src="https://www.us-analytics.com/hubfs/EPBCS%20strategic%20modeling.jpg?t=1519157959954" alt="EPBCS strategic modeling.jpg" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div> <p>What’s your biggest problem when it comes to financial modeling? The answer we typically hear is spreadsheets. Of course, there’s nothing wrong with using a spreadsheet — Excel is a great tool that can <em>assist </em>with many of your processes. However, only using a customized spreadsheet for financial modeling can create data inconsistency and lacks transparency.</p> <p><a href="https://www.us-analytics.com/hyperionblog/pbcs-vs-epbcs-comparing-oracle-cloud-planning-applications">Oracle Enterprise Planning and Budgeting Cloud Service’s (EPBCS)</a> Strategic Modeling module was created to help you solve all the problems caused by using a spreadsheet for financial modeling and impact analysis.</p> <p>In line with EPBCS’s out-of-the-box features and functions, Strategic Modeling comes with out-of-the-box capabilities. In this blog post, we’ll cover those capabilities, how Strategic Modeling works, and why you should use it.</p> <img src="https://track.hubspot.com/__ptq.gif?a=135305&amp;k=14&amp;r=https%3A%2F%2Fwww.us-analytics.com%2Fhyperionblog%2Fstrategic-modeling-with-epbcs&amp;bu=https%253A%252F%252Fwww.us-analytics.com%252Fhyperionblog&amp;bvt=rss" alt="" width="1" height="1" style="min-height:1px!important;width:1px!important;border-width:0!important;margin-top:0!important;margin-bottom:0!important;margin-right:0!important;margin-left:0!important;padding-top:0!important;padding-bottom:0!important;padding-right:0!important;padding-left:0!important; "> Michelle Heath https://www.us-analytics.com/hyperionblog/strategic-modeling-with-epbcs Tue Nov 07 2017 16:11:16 GMT-0500 (EST) Using Oracle’s Baseline Validation Tool with OBIEE — Part 2 https://blog.redpillanalytics.com/using-oracles-baseline-validation-tool-with-obiee-part-2-c9a5572f80bb?source=rss----abcc62a8d63e---4 <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*QDoW9rV_FbRCrz6TrXbgoQ.jpeg" /></figure><p>This post is part 2 of 4 about using the Baseline Validation Tool (BVT) with Oracle Business Intelligence (OBIEE). Post 1 with an intro to BVT, can be found <a href="https://blog.redpillanalytics.com/using-oracles-baseline-validation-tool-with-obiee-part-1-328be6fbb6bc">here</a>.</p><h3>Obtain the BVT tool</h3><ol><li>Download the latest version of BVT from Oracle. <a href="http://www.oracle.com/technetwork/middleware/bi/downloads/bi-bvt-download-3587672.html">http://www.oracle.com/technetwork/middleware/bi/downloads/bi-bvt-download-3587672.html</a></li><li>Unzip the download into a directory on your computer. To save yourself typing later on, I recommend not embedding this too far into other folders. I put mine in D:/oracle.bi.bvt</li><li>Once unzipped, the tool is ready to use.</li></ol><h3>Create the XML input file</h3><p>I started out by creating a folder called Scripts or Configs in my BVT folder. This will allow me to keep all of my configuration scripts organized within the BVT folder.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*At75ccjy88P-SkDaQcWGiA.png" /></figure><p>Why do I have so many configuration files? I create a new file for each catalog folder that I’m testing or each different type of plug-in test I’m using or even for the purpose of why I’m testing such as 12c Upgrade or XYZ Project Validation.</p><p>Next open the textconfig.xml file in a code or text editor and save it in your scripts folder with a new name. I suggest giving it a name corresponding to the folder and the test that you’ll be running with this script. If you don’t have this file, I’ve copied it to the bottom of this blog post.</p><h4>Deployment Section</h4><p>Within the config file, we’ll first tackle the Deployment section where we specify the Instances that we’ll be running BVT on. The testconfig file shows two deployments but you can put more than two in here. Say for instance you have a dev, test, and prod environment, you can put all three in so that your file is ready to be run on whichever environment you might desire.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*MQKQmNFctAImmk97FuMg_w.png" /></figure><p>Here’s the definitions and what I changed in this section:</p><ul><li>Deployment Name — This name is used when you run BVT. Give it a concise yet descriptive name.</li><li>Analytics URL — This will point to your answers instance. Be sure to include http at the beginning and /analytics at the end</li><li>XmlpURL — If you’ll be running the BIP test, you’ll need to point this to your BI Publisher instance</li><li>VaURL — If you’ll be running the VA (Data Visualizer) test, you’ll need to point this to your VA instance</li><li>UserName — Give a user that will not be restricted in what data is shown, unless you are specifically testing security settings.</li><li>Password — The password for that user. Yes this is clear text and not encrypted.</li></ul><p>A more secure way of providing your password is to use –password when calling the bvt procedure instead of storing your password in your config file. If you type –password without providing the password, you will be prompted to enter it when running the tests.</p><h4>Tests Section</h4><p>The Tests section of the XML is where you specify which tests to run and which folder to run them on, along with specific settings for each test. The test name can be found after com.oracle.biee.bvt.plugin in the TestPlugin name tag. By default all of the tests are set to true. To turn each test off, in the TestPlugin tag, set enabled=“false”.</p><p>I’ve found it easiest to have a separate script for each test and run each test individually to keep the results separated out and concise.</p><p>Each test has a tag for the Parameter name of CatalogRoot. This is where you put the path to the folder you’d like the test to run on. For a folder within the Shared Folders structure, you will put “/shared/&lt;folder name&gt;”. Note that you cannot put multiple folders in this list. If you want two shared folders tested, you either need to run against your whole shared catalog or run two separate tests.</p><p><strong>Catalog Plug-In Parameters</strong></p><p>The only setting in the config for this test is CatalogRoot where you specify which folder to run this test against.</p><p><strong>Reports Plug-In Parameters</strong></p><ul><li>ReadTimeout: The amount of time to allow each report to run before moving to the next report. This is in milliseconds.</li><li>CatalogRoot: Which folder to run this test against. This can be set differently for each type of report export (Excel, PDF, or csv) if you’d like. To run on the entire catalog, specify value=”/” (but this is not recommended).</li><li>ScoreThreshold: For Excel &amp; PDF. This is an algorithm that scores the similarity of the exports. A threshold of 1 is a perfect match.</li><li>DiffTolerance: For CSV exports. The number of decimal places of difference to tolerate for fluctuations in the data. 0 is no tolerance. 0.1 would flag a difference in one field value greater than 0.1 between the two exports.</li></ul><p><strong>UI Plug-In Parameters</strong></p><ul><li>CatalogRoot: Which folder to run this test against. To run on the entire catalog, specify value=”/” (but this is not recommended).</li><li>ThreadQueueSize: The number of concurrent browsers to use: 0–50.</li><li>ThreadTimeout: The amount of time to allow each report to run before moving to the next report. This is in milliseconds.</li><li>BrowserType: Which browser to use for testing. Leave blank for default browser. Firefox or InternetExplorer.</li><li>FirefoxLocationInLinus: If using Linux, the location of Firefox to use. Leave blank for default.</li><li>FindReportSnapshotDifferences: Capture screenshots and comparisons of reports within the specified catalog root folder.</li><li>FindDashboardSnapshotDifferences: Capture screenshots and comparisons of dashboards within the specified catalog root folder.</li><li>PromptInputFile: See Dashboard Prompts Input below.</li><li>ScoreThreshold: This is an algorithm that scores the similarity of the screen captures. A threshold of 1 is a perfect match.</li></ul><p><strong>Dashboard Plug-In Parameters</strong></p><ul><li>ExportDashboardsToXML: If set to true, all of the dashboards in the dashboard prompts file AND all of the dashboards found under the Catalog Root folder will be processed. If false, only the dashboards in the dashboard prompts file will be processed.</li><li>CatalogRoot: Which folder to run this test against. To run on the entire catalog, specify value=”/” (but this is not recommended).</li><li>PromptInputFile: The path (if not in the base bvt folder) and name of the file containing the Prompt URLs to each dashboard page. See Dashboard Prompts Input File section below for more details about this file.</li><li>ExportAllDashboards: Set to true if you want BVT to export and test all dashboards within catalog root as specified in the export. If this is set to false, it will only test the reports in the dashboard prompts input file.</li><li>DiffTolerance: Set a decimal point that should be tolerated for fluctuations in data. “0” is no tolerance. Suggested values are “0.1”, “0.01”, etc.</li></ul><p><strong>BI Publisher Plug-In Parameters</strong></p><p>The BI Publisher Plug-in (called BIP in BVT) has two test types: Export all BI Publisher reports in a specific folder or use a parameters input file to specify the BI Publisher reports to test</p><ul><li>ExportReportsToPDF: If set to true, BIP plug-in will test all of the BI Publisher reports in the Catalog Root specified folder.</li><li>CatalogRoot: For running the ExportReportsToPDF test. Unlike the rest of the plug-ins, the catalog root for the BIP plug-in is different. This plug-in uses the physical path instead of the virtual path under /shared/. For example, if you are using “/shared/Sample Lite/Published Reporting” for other plug-ins, in the BIP plug-in you would use “/Sample Lite/Published Reporting”.</li><li>ExportReportsWithParametersToPDF: If set to true, BIP plug-in will use a parameter input file to determine which BIP reports to export and compare.</li><li>ParametersInputFile: For the ExportReportsWithParametersToPDF test. Similar to the Dashboard Prompts file (described below), this parameter will point to the input file containing links with BIP report parameters populated within the URL.</li><li>ScoreThreshold: Specified for both tests. This is an algorithm that scores the similarity of the report PDF exports. A threshold of 1 is a perfect match.</li></ul><p><strong>VA Plug-In Parameters</strong></p><p>These plug-in parameters are nearly identical to the UI plug-in parameters.</p><ul><li>CatalogRoot: Which folder to run this test against.</li><li>ThreadQueueSize: The number of concurrent browsers to use: 0–50.</li><li>ThreadTimeout: The amount of time to allow each report to run before moving to the next report. This is in milliseconds.</li><li>BrowserType: Which browser to use for testing. Leave blank for default browser. Firefox or InternetExplorer.</li><li>FirefoxLocationInLinus: If using Linux, the location of Firefox to use. Leave blank for default.</li><li>FindVAProjectSnapshotDifferences: Capture screenshots and comparisons of VA projects within the specified catalog root folder.</li><li>ScoreThreshold: This is an algorithm that scores the similarity of the screen captures. A threshold of 1 is a perfect match.</li></ul><h4>Dashboard Prompts Input File</h4><p>For the UI plug-in Dashboard Snapshot Differences test or the Dashboard plug-in, you can force BVT to use certain prompt values in your dashboard prompts to ensure consistency when testing. The file should contain URLs to each dashboard to be tested with the parameter values included in the URL. For the Dashboard test, it’s possible to restrict BVT to only run the dashboards that are contained in this file. This is another way that you can better specify the specific dashboard pages to test if you are not able to get specific enough using the Catalog Root parameter.</p><p>To create the Dashboard Prompts file:</p><ol><li>Open a blank text file in notepad or a text editor.</li><li>Open a web browser and navigate to the dashboard page you want to test.</li><li>Select the prompt values you’d like to use on the dashboard for the test.</li><li>In the upper right corner of the dashboard, click Page Options — Create Prompted Link.</li><li>Copy the URL from the browser into the text file on a new line.</li><li>Repeat steps 2–5 for each Dashboard Page that you would like to test.</li><li>Save the file as DashboardPrompts.txt in your BVT folder. This specific name is not required. You can name this as specific as you want to describe the dashboards that you are specifying within it. When I test, I name this similar to the name of the bvt config file that I am creating for this test.</li><li>Specify this dashboardsprompts.txt file (along with any necessary path if not saved in the bvt folder) in the PromptInputFile parameter in your config file.</li></ol><h4>BI Publisher Parameters Input File</h4><p>For the BI Publisher plug-in test, you can use a parameters input file to specify the values that should be selected for the parameters in each report that is to be tested. The file should contain URLs to each report to be tested with the parameter values included in the URL.</p><p>To create the Parameter Input file:</p><ol><li>Open a blank text file in notepad or a text editor.</li><li>Open a web browser and navigate to the report you want to test on the xmlpserver. Important! You must use the xmlpserver.</li><li>Select the parameter values you’d like on the report for this test.</li><li>In the upper right corner of the report, click Action Option — Share Report Link. Choose Current Page.</li><li>Copy the URL from the browser into the text file on a new line.</li><li>Repeat steps 2–5 for each BIP report that you would like to test.</li><li>Save the file as ParametersInput.txt in your BVT folder. This specific name is not required. You can name this as specific as you want to describe the reports that you are specifying within it. When I test, I name this similar to the name of the bvt config file that I am creating for this test.</li><li>Specify this ParametersInput.txt file (along with any necessary path if not saved in the bvt folder) in the ParametersInput parameter in your config file.</li></ol><p>You do not need to create a parameters URL for each BI Publisher environment that you’ll be running your tests against. As long as the catalog paths match in your testing environments, BVT will figure out the deployment path to each report in each environment.</p><h3>Results Section</h3><p>The last section of the config file is the Results section. Here is where you can specify the name of the folder where the results will be stored. The default is “Results”. I recommend changing this to something similar to what you titled the config script where it contains the name of the folder the test will be run on, and the test(s) run. There is also the ability to specify that the folders are timestamped. This is helpful if you will be running the test multiple times and do not want the folder results overwritten. *See my note in Part 3 about why this is nice but also makes the code for comparing results a bit more difficult to create.</p><pre>&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br>&lt;TestConfiguration&gt;</pre><pre>&lt;Deployment name=&quot;PreUpgrade&quot; description=&quot;First Test Target&quot;&gt;<br> &lt;Server&gt;<br> &lt;!-- AnalyticsURL Needs to point to the analytics page --&gt;<br> &lt;!-- XmlpURL Needs to point to the BI Publisher page --&gt;<br> &lt;!-- ex:&lt;AnalyticsURL&gt;http://servername:9704/analytics&lt;/AnalyticsURL&gt; --&gt;<br> &lt;!-- ex: &lt;XmlpURL&gt;https://servername/xmlpserver&lt;/XmlpURL&gt; --&gt;<br> &lt;!-- ex: &lt;VaURL&gt;https://servername/va&lt;/VaURL&gt; --&gt;<br> &lt;!-- If you are using a test certificate on the server for SSL and want to bypass SSL certificate validation, set the IgnoreSSLCertErrors to true. This setting is strictly for Test environments only --&gt;<br> &lt;AnalyticsURL&gt;&lt;/AnalyticsURL&gt;<br> &lt;XmlpURL&gt;&lt;/XmlpURL&gt;<br> &lt;VaURL&gt;&lt;/VaURL&gt;<br> &lt;UserName&gt;&lt;/UserName&gt;<br> &lt;Password&gt;&lt;/Password&gt;<br> &lt;IgnoreSSLCertErrors&gt;false&lt;/IgnoreSSLCertErrors&gt;<br> &lt;/Server&gt;<br>&lt;/Deployment&gt;</pre><pre>&lt;Deployment name=&quot;PostUpgrade&quot; description=&quot;Second Test Target&quot;&gt;<br> &lt;Server&gt;<br> &lt;!-- AnalyticsURL Needs to point to the analytics page --&gt;<br> &lt;!-- XmlpURL Needs to point to the BI Publisher page --&gt;<br> &lt;!-- ex: &lt;AnalyticsURL&gt;http://servername:9704/analytics&lt;/AnalyticsURL&gt; --&gt;<br> &lt;!-- ex: &lt;XmlpURL&gt;https://servername/xmlpserver&lt;/XmlpURL&gt; --&gt;<br> &lt;!-- ex: &lt;VaURL&gt;https://servername/va&lt;/VaURL&gt; --&gt;<br> &lt;!-- If you are using a test certificate on the server for SSL and want to bypass SSL certificate validation, set the IgnoreSSLCertErrors to true. This setting is strictly for Test environments only --&gt;<br> &lt;AnalyticsURL&gt;&lt;/AnalyticsURL&gt;<br> &lt;XmlpURL&gt;&lt;/XmlpURL&gt;<br> &lt;VaURL&gt;&lt;/VaURL&gt;<br> &lt;UserName&gt;&lt;/UserName&gt;<br> &lt;Password&gt;&lt;/Password&gt;<br> &lt;IgnoreSSLCertErrors&gt;false&lt;/IgnoreSSLCertErrors&gt;<br> &lt;/Server&gt;<br>&lt;/Deployment&gt;</pre><pre>&lt;Tests&gt;<br>&lt;!-- CAUTION: The CatalogRoot Value for BIP Plugin is different than other plugins--&gt;<br>&lt;!-- For BIP remove the virtual paths where the other plugins use physical paths--&gt;<br>&lt;!-- To get the physical path of an item, in the Oracle Anwsers catalog, right click the item and select &quot;Properties&quot;--&gt;<br>&lt;!-- Ex: For BIP : &quot;/Sample Lite/Published Reporting&quot;--&gt;<br>&lt;!-- Ex: For others: &quot;/shared/Sample Lite/Published Reporting&quot;--&gt;</pre><pre>&lt;TestPlugin name=&quot;com.oracle.biee.bvt.plugin.catalog&quot; enabled=&quot;true&quot;&gt;<br> &lt;Test name=&quot;GetCatalogTest&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;/Test&gt;<br>&lt;/TestPlugin&gt;</pre><pre>&lt;TestPlugin name=&quot;com.oracle.biee.bvt.plugin.ui&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;!-- how many threads to spawn to load reports, should be greater than 0, less than 50 --&gt;<br> &lt;Parameter name=&quot;ThreadQueueSize&quot; value=&quot;1&quot; /&gt;<br> &lt;!-- Timeout for loading each report in MSecs should be between 5 secs and 10 mins --&gt;<br> &lt;Parameter name=&quot;ThreadTimeout&quot; value=&quot;60000&quot; /&gt;<br> &lt;!-- Which BrowserType to use to load reports, Firefox, InternetExplorer. Leave empty for default browser --&gt;<br> &lt;Parameter name=&quot;BrowserType&quot; value=&quot;&quot;/&gt;<br> &lt;!-- Location of Firefox browser to be used, if multiple instances of Firefox browser exists on a Linux operating system machine. Leave empty for default browser location --&gt;<br> &lt;Parameter name=&quot;FirefoxLocationInLinux&quot; value=&quot;&quot;/&gt;</pre><pre> &lt;Test name=&quot;FindReportSnapshotDifferences&quot; enabled=&quot;true&quot;&gt;<br> &lt;!-- ScoreThreshold should be between 0.00 and 1.00 --&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;</pre><pre> &lt;Test name=&quot;FindDashboardSnapshotDifferences&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;PromptInputFile&quot; value=&quot;DashboardPrompts.txt&quot; /&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;<br>&lt;/TestPlugin&gt;</pre><pre>&lt;TestPlugin name=&quot;com.oracle.biee.bvt.plugin.report&quot; enabled=&quot;true&quot;&gt;<br> &lt;!-- Timeout for loading each report in MSecs should be between 5 secs and 10 mins --&gt;<br> &lt;Parameter name=&quot;ReadTimeout&quot; value=&quot;15000&quot; /&gt;<br> &lt;Test name=&quot;ExportReportsToPDF&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;<br> &lt;Test name=&quot;ExportReportsToExcel2007&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;<br> &lt;Test name=&quot;ExportReportsToCSV&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;!-- Set a limit on the maximum tolerance for fluctuations in floating point numbers in report data. Ex:&quot;0&quot; for no tolerance. &quot;0.1, &quot;0.001&quot;, etc.--&gt;<br> &lt;Parameter name=&quot;DiffTolerance&quot; value=&quot;0&quot;/&gt;<br> &lt;/Test&gt;<br>&lt;/TestPlugin&gt;</pre><pre>&lt;TestPlugin name=&quot;com.oracle.biee.bvt.plugin.dashboard&quot; enabled=&quot;true&quot;&gt;<br> &lt;Test name=&quot;ExportDashboardsToXML&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;!-- Paste the prompted links to the following file--&gt;<br> &lt;Parameter name=&quot;PromptInputFile&quot; value=&quot;DashboardPrompts.txt&quot;/&gt;<br> &lt;Parameter name=&quot;ExportAllDashboards&quot; value=&quot;true&quot;/&gt;<br> &lt;!-- Set a limit on the maximum tolerance for fluctuations in floating point numbers in report data. Ex:&quot;0&quot; for no tolerance. &quot;0.1, &quot;0.001&quot;, etc.--&gt;<br> &lt;Parameter name=&quot;DiffTolerance&quot; value=&quot;0&quot;/&gt;<br> &lt;/Test&gt;<br>&lt;/TestPlugin&gt;</pre><pre>&lt;TestPlugin name=&quot;com.oracle.biee.bvt.plugin.bip&quot; enabled=&quot;true&quot;&gt;<br> &lt;Test name=&quot;ExportReportsToPDF&quot; enabled=&quot;true&quot;&gt;<br> &lt;!-- The CatalogRoot Value for BIP Plugin is different than other plugins--&gt;<br> &lt;!-- For BIP remove the virtual paths where the other plugins use physical paths--&gt;<br> &lt;!-- Ex: For BIP : &quot;/Sample Lite/Published Reporting&quot;--&gt;<br> &lt;!-- Ex: For others: &quot;/shared/Sample Lite/Published Reporting&quot;--&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;<br> &lt;Test name=&quot;ExportReportsWithParametersToPDF&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;ParametersInputFile&quot; value=&quot;ParametersInputs.txt&quot; /&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;<br>&lt;/TestPlugin&gt;</pre><pre>&lt;TestPlugin name=&quot;com.oracle.biee.bvt.plugin.va&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;CatalogRoot&quot; value=&quot;/&quot;/&gt;<br> &lt;!-- how many threads to spawn to load reports, should be greater than 0, less than 50 --&gt;<br> &lt;Parameter name=&quot;ThreadQueueSize&quot; value=&quot;1&quot; /&gt;<br> &lt;!-- Timeout for loading each report in MSecs should be between 5 secs and 10 mins --&gt;<br> &lt;Parameter name=&quot;ThreadTimeout&quot; value=&quot;60000&quot; /&gt;<br> &lt;!-- Which BrowserType to use to load reports, Firefox, InternetExplorer. Leave empty for default browser --&gt;<br> &lt;Parameter name=&quot;BrowserType&quot; value=&quot;&quot;/&gt;<br> &lt;!-- Location of Firefox browser to be used, if multiple instances of Firefox browser exists on a Linux operating system machine. Leave empty for default browser location --&gt;<br> &lt;Parameter name=&quot;FirefoxLocationInLinux&quot; value=&quot;&quot;/&gt;<br> &lt;Test name=&quot;FindVAProjectSnapshotDifferences&quot; enabled=&quot;true&quot;&gt;<br> &lt;Parameter name=&quot;ScoreThreshold&quot; value=&quot;0.95&quot;/&gt;<br> &lt;/Test&gt;<br>&lt;/TestPlugin&gt;</pre><pre>&lt;/Tests&gt;</pre><pre>&lt;Results&gt;<br> &lt;LogPath timestampFolders=&quot;false&quot;&gt;Results&lt;/LogPath&gt;<br>&lt;/Results&gt;</pre><pre>&lt;/TestConfiguration&gt;</pre><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c9a5572f80bb" width="1" height="1"><hr><p><a href="https://blog.redpillanalytics.com/using-oracles-baseline-validation-tool-with-obiee-part-2-c9a5572f80bb">Using Oracle’s Baseline Validation Tool with OBIEE — Part 2</a> was originally published in <a href="https://blog.redpillanalytics.com">Red Pill Analytics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p> Michelle Kolbe https://medium.com/p/c9a5572f80bb Tue Nov 07 2017 12:00:55 GMT-0500 (EST) Taking KSQL for a Spin Using Real-time Device Data http://www.rittmanmead.com/blog/2017/11/taking-ksql-for-a-spin-using-real-time-device-data/ <h1 id="takingksqlforaspinusingrealtimedevicedata">Taking KSQL for a Spin Using Real-time Device Data</h1> <img src="http://www.rittmanmead.com/blog/content/images/2017/11/Screenshot_2.png" alt="Taking KSQL for a Spin Using Real-time Device Data"><p>Evaluating <a href="https://github.com/confluentinc/ksql/">KSQL</a> has been high on my to-do list ever since it was released back in August. I wanted to experiment with it using an interesting, high velocity, real-time data stream that would allow me to analyse events at the millisecond level, rather than seconds or minutes. Finding such a data source, that is free of charge and not the de facto twitter stream, is tricky. So, after some pondering, I decided that I'd use my Thrustmaster T300RS Steering Wheel/Pedal Set gaming device as a data source,</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/device-4.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>The idea being that the data would be fed into Kafka, processed in real-time using KSQL and visualised in Grafana. </p> <p>This is the end to end pipeline that I created...</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/pipeline-6.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>...and this is the resulting real-time dashboard running alongside a driving game and a log of the messages being sent by the device.</p> <iframe src="https://player.vimeo.com/video/240169902" width="640" height="360" frameborder="0" webkitallowfullscreen="" mozallowfullscreen="" allowfullscreen></iframe> <p>This article will explain how the above real-time dashboard was built using only KSQL...and a custom Kafka producer.</p> <p>I'd like to point out, that although the device I'm using for testing is unconventional, when considered in the wider context of IoT's, autonomous driving, smart automotives or any device for that matter, it will be clear to see that the low latency, high throughput of Apache Kafka, coupled with Confluent's KSQL, can be a powerful combination. </p> <p>I'd also like to point out, that this article is <em>not</em> about driving techniques, driving games or telemetry analysis. However, seeing as the data source I'm using is intrinsically tied to those subjects, the concepts will be discussed to add context. I hope you like motorsports! </p> <h2 id="writingakafkaproducerforat300rs">Writing a Kafka Producer for a T300RS</h2> <p>The T300RS is attached to my Windows PC via a USB cable, so the first challenge was to try and figure out how I could get steering, braking and accelerator inputs pushed to Kafka. Unsurprisingly, a source connector for a "T300RS Steering Wheel and Pedal Set" was not listed on the <a href="https://docs.confluent.io/current/connect/intro.html">Kafka Connect</a> web page - a custom producer was the only option.</p> <p>To access the data being generated by the T300RS, I had 2 options, I could either use an existing Telemetry API from one of my racing games, or I could access it directly using the Windows DirectX API. I didn't want to have to have a game running in the background in order to generate data, so I decided to go down the DirectX route. This way, the data is <em>raw</em> and available, with or without an actual game engine running.</p> <p>The producer was written using the <a href="http://sharpdx.org/">SharpDX .NET wrapper</a> and <a href="https://github.com/confluentinc/confluent-kafka-dotnet">Confluent's .NET Kafka Client</a>. The SharpDX directinput API allows you to poll an attached input device (mouse, keyboard, game controllers etc.) and read its buffered data. The buffered data returned within each polling loop is serialized into JSON and sent to Kafka using the .NET Kafka Client library. </p> <p>A single message is sent to a topic in Kafka called <code>raw_axis_inputs</code> every time the state of one the device's axes changes. The device has several axes, in this article I am only interested in the Wheel, Accelerator, Brake and the X button. </p> <pre><code>{ "event_id":4300415, // Event ID unique over all axis state changes "timestamp":1508607521324, // The time of the event "axis":"Y", // The axis this event belongs to "value":32873.0 // the current value of the axis } </code></pre> <p>This is what a single message looks like. In the above message the Brake axis state was changed, i.e. it moved to a new position with value 32873.</p> <p>You can see below which inputs map to the each reported axis from the device. </p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/device_annotated-5.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>Here is a sample from the producer's log file. </p> <pre><code>{"event_id":4401454,"timestamp":1508687373018,"axis":"X","value":33007.0} {"event_id":4401455,"timestamp":1508687373018,"axis":"RotationZ","value":62515.0} {"event_id":4401456,"timestamp":1508687373018,"axis":"RotationZ","value":62451.0} {"event_id":4401457,"timestamp":1508687373018,"axis":"X","value":33011.0} {"event_id":4401458,"timestamp":1508687373018,"axis":"RotationZ","value":62323.0} {"event_id":4401459,"timestamp":1508687373018,"axis":"RotationZ","value":62258.0} {"event_id":4401460,"timestamp":1508687373034,"axis":"X","value":33014.0} {"event_id":4401461,"timestamp":1508687373034,"axis":"X","value":33017.0} {"event_id":4401462,"timestamp":1508687373065,"axis":"RotationZ","value":62387.0} {"event_id":4401463,"timestamp":1508687373081,"axis":"RotationZ","value":62708.0} {"event_id":4401464,"timestamp":1508687373081,"axis":"RotationZ","value":62901.0} {"event_id":4401465,"timestamp":1508687373081,"axis":"RotationZ","value":62965.0} {"event_id":4401466,"timestamp":1508687373097,"axis":"RotationZ","value":64507.0} {"event_id":4401467,"timestamp":1508687373097,"axis":"RotationZ","value":64764.0} {"event_id":4401468,"timestamp":1508687373097,"axis":"RotationZ","value":64828.0} {"event_id":4401469,"timestamp":1508687373097,"axis":"RotationZ","value":65021.0} {"event_id":4401470,"timestamp":1508687373112,"axis":"RotationZ","value":65535.0} {"event_id":4401471,"timestamp":1508687373268,"axis":"X","value":33016.0} {"event_id":4401472,"timestamp":1508687373378,"axis":"X","value":33014.0} {"event_id":4401473,"timestamp":1508687377972,"axis":"Y","value":65407.0} {"event_id":4401474,"timestamp":1508687377987,"axis":"Y","value":64057.0} {"event_id":4401475,"timestamp":1508687377987,"axis":"Y","value":63286.0} </code></pre> <p>You can tell by looking at the timestamps, it's possible to have multiple events generated within the same millisecond, I was unable to get microsecond precision from the device unfortunately. When axes, <code>"X"</code>, <code>"Y"</code> and <code>"RotationZ"</code> are being moved quickly at the same time (a bit like a child driving one of those coin operated car rides you find at the seaside) the device generates approximately 500 events per second.</p> <h1 id="creatingasourcestream">Creating a Source Stream</h1> <p>Now that we have data streaming to Kafka from the device, it's time to fire up KSQL and start analysing it. The first thing we need to do is create a source stream. The saying "Every River Starts with a Single Drop" is quite fitting here, especially in the context of <em>stream</em> processing. The <code>raw_axis_inputs</code> topic is our "Single Drop" and we need to create a KSQL stream based on top of it.</p> <pre><code>CREATE STREAM raw_axis_inputs ( \ event_id BIGINT, \ timestamp BIGINT, \ axis VARCHAR, \ value DOUBLE ) \ WITH (kafka_topic = 'raw_axis_inputs', value_format = 'JSON'); </code></pre> <p>With the stream created we can we can now query it. I'm using the default <code>auto.offset.reset = latest</code> as I have the luxury of being able to blip the accelerator whenever I want to generate new data, a satisfying feeling indeed. </p> <pre><code>ksql&gt; SELECT * FROM raw_axis_inputs; 1508693510267 | null | 4480290 | 1508693510263 | RotationZ | 65278.0 1508693510269 | null | 4480291 | 1508693510263 | RotationZ | 64893.0 1508693510271 | null | 4480292 | 1508693510263 | RotationZ | 63993.0 1508693510273 | null | 4480293 | 1508693510263 | RotationZ | 63094.0 1508693510275 | null | 4480294 | 1508693510279 | RotationZ | 61873.0 1508693510277 | null | 4480295 | 1508693510279 | RotationZ | 60716.0 1508693510279 | null | 4480296 | 1508693510279 | RotationZ | 60267.0 </code></pre> <h1 id="derivedstreams">Derived Streams</h1> <p>We now have our source stream created and can start creating some derived streams from it. The first derived stream we are going to create filters out 1 event. When the X button is <em>pressed</em> it emits a value of 128, when it's <em>released</em> it emits a value of 0. </p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/Xbutton-5.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>To simplify this input, I'm filtering out the <em>release</em> event. We'll see what the X button is used for later in the article.</p> <pre><code>CREATE STREAM axis_inputs WITH (kafka_topic = 'axis_inputs') AS \ SELECT event_id, \ timestamp, \ axis, \ value \ FROM raw_axis_inputs \ WHERE axis != 'Buttons5' OR value != 0.0; </code></pre> <p>From this stream we are going to create 3 further streams, one for the brake, one the accelerator and one for the wheel.</p> <p>All 3 axes emit values in the range of 0-65535 across their full range. The wheel emits a value of 0 when rotated fully left, a value of 65535 when rotated fully right and 32767 when dead centre. The wheel itself is configured to rotate 900 degrees lock-to-lock, so it would be nice to report its last state change in degrees, rather than from a predetermined integer range. For this we can create a new stream, that includes only messages where the <code>axis = 'X'</code>, and the axis values are translated into the range of -450 degrees to 450 degrees. With this new value translation, maximum rotation left now equates to 450 degrees and maximum rotation right equates -450 degrees, 0 is now dead centre.</p> <pre><code>CREATE STREAM steering_inputs WITH (kafka_topic = 'steering_inputs') AS \ SELECT axis, \ event_id, \ timestamp, \ (value / (65535.0 / 900.0) - 900 / 2) * -1 as value \ FROM axis_inputs \ WHERE axis = 'X'; </code></pre> <p>If we now query our new stream and move the wheel slowly around dead centre, we get the following results</p> <pre><code>ksql&gt; select timestamp, value from steering_inputs; 1508711287451 | 0.6388888888889142 1508711287451 | 0.4305555555555429 1508711287451 | 0.36111111111108585 1508711287451 | 0.13888888888891415 1508711287451 | -0.0 1508711287467 | -0.041666666666685614 1508711287467 | -0.26388888888891415 1508711287467 | -0.3333333333333144 1508711287467 | -0.5277777777777715 1508711287467 | -0.5972222222222285 </code></pre> <p>The same query while the wheel is rotated fully left</p> <pre><code>1508748345943 | 449.17601281757845 1508748345943 | 449.3270771343557 1508748345943 | 449.5330739299611 1508748345943 | 449.67040512703136 1508748345959 | 449.8214694438087 1508748345959 | 449.95880064087896 1508748345959 | 450.0 </code></pre> <p>And finally, rotated fully right.</p> <pre><code>1508748312803 | -449.3408102540627 1508748312803 | -449.4369420920119 1508748312818 | -449.67040512703136 1508748312818 | -449.7390707255665 1508748312818 | -449.9725337605859 1508748312818 | -450.0 </code></pre> <p>Here's the data plotted in Grafana.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/steering_inputs-7.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>We now need to create 2 more derived streams to handle the accelerator and the brake pedals. This time, we want to translate the values to the range 0-100. When a pedal is fully depressed it should report a value of 100 and when fully released, a value of 0.</p> <pre><code class="language- ">CREATE STREAM accelerator_inputs WITH (kafka_topic = 'accelerator_inputs') AS \ SELECT axis, \ event_id, \ timestamp, \ 100 - (value / (65535.0 / 100.0)) as value \ FROM axis_inputs \ WHERE axis = 'RotationZ'; </code></pre> <p>Querying the <code>accelerator_inputs</code> stream while fully depressing the accelerator pedal displays the following. (I've omitted many records in the middle to keep it short)</p> <pre><code>ksql&gt; SELECT timestamp, value FROM accelerator_inputs; 1508749747115 | 0.0 1508749747162 | 0.14198473282442592 1508749747193 | 0.24122137404580712 1508749747209 | 0.43664122137404604 1508749747225 | 0.5343511450381726 1508749747287 | 0.6335877862595396 1508749747318 | 0.7312977099236662 1508749747318 | 0.8290076335877927 1508749747334 | 0.9267175572519051 1508749747381 | 1.0259541984732863 ... ... 1508749753943 | 98.92519083969465 1508749753959 | 99.02290076335878 1508749753959 | 99.1206106870229 1508749753959 | 99.21832061068702 1508749753975 | 99.31603053435114 1508749753975 | 99.41374045801527 1508749753975 | 99.5114503816794 1508749753990 | 99.60916030534351 1508749753990 | 99.70687022900763 1508749753990 | 99.80458015267176 1508749754006 | 100.0 </code></pre> <p>...and displayed in Grafana</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/accelerator_inputs-7.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>Finally, we create the brake stream, which has the same value translation as the accelerator stream, so I won't show the query results this time around. </p> <pre><code>CREATE STREAM brake_inputs WITH (kafka_topic = 'brake_inputs') AS \ SELECT axis, \ event_id, \ timestamp, \ 100 - (value / (65535 / 100)) as value \ FROM axis_inputs \ WHERE axis = 'Y'; </code></pre> <p>Braking inputs in Grafana.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/braking_inputs-7.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <h1 id="smoothisfast">Smooth is Fast</h1> <p>It is a general rule of thumb in motorsports that "Smooth is Fast", the theory being that the less steering, accelerator and braking inputs you can make while still keeping the car on the desired racing line, results in a faster lap time. We can use KSQL to count the number of inputs for each axis over a <a href="https://github.com/confluentinc/ksql/blob/0.1.x/docs/syntax-reference.md#select">Hopping Window</a> to try and capture overall smoothness. To do this, we create our first KSQL table.</p> <pre><code class="language- ">CREATE TABLE axis_events_hopping_5s_1s \ WITH (kafka_topic = 'axis_events_hopping_5s_1s') AS \ SELECT axis, \ COUNT(*) AS event_count \ FROM axis_inputs \ WINDOW HOPPING (SIZE 5 SECOND, ADVANCE BY 1 SECOND) \ GROUP BY axis; </code></pre> <p>A KSQL table is basically a view over an existing stream or another table. When a table is created from a stream, it needs to contain an aggregate function and group by clause. It's these aggregates that make a table stateful, with the underpinning stream updating the table's current view in the background. If you create a table based on another table you do <em>not</em> need to specify an aggregate function or group by clause. </p> <p>The table we created above specifies that data is aggregated over a <a href="https://github.com/confluentinc/ksql/blob/0.1.x/docs/syntax-reference.md#select">Hopping Window</a>. The size of the window is 5 seconds and it will advance or <em>hop</em> every 1 second. This means that at any one time, there will be 5 open windows, with new data being directed to each window based on the key and the record's timestamp.</p> <p>You can see below when we query the stream, that we have 5 open windows per axis, with each window 1 second apart.</p> <pre><code>ksql&gt; SELECT * FROM axis_events_hopping_5s_1s; 1508758267000 | X : Window{start=1508758267000 end=-} | X | 56 1508758268000 | X : Window{start=1508758268000 end=-} | X | 56 1508758269000 | X : Window{start=1508758269000 end=-} | X | 56 1508758270000 | X : Window{start=1508758270000 end=-} | X | 56 1508758271000 | X : Window{start=1508758271000 end=-} | X | 43 1508758267000 | Y : Window{start=1508758267000 end=-} | Y | 25 1508758268000 | Y : Window{start=1508758268000 end=-} | Y | 25 1508758269000 | Y : Window{start=1508758269000 end=-} | Y | 25 1508758270000 | Y : Window{start=1508758270000 end=-} | Y | 32 1508758271000 | Y : Window{start=1508758271000 end=-} | Y | 32 1508758267000 | RotationZ : Window{start=1508758267000 end=-} | RotationZ | 67 1508758268000 | RotationZ : Window{start=1508758268000 end=-} | RotationZ | 67 1508758269000 | RotationZ : Window{start=1508758269000 end=-} | RotationZ | 67 1508758270000 | RotationZ : Window{start=1508758270000 end=-} | RotationZ | 67 1508758271000 | RotationZ : Window{start=1508758271000 end=-} | RotationZ | 39 </code></pre> <p>This data is going to be pushed into InfluxDB and therefore needs a timestamp column. We can create a new table for this, that includes all columns from our current table, plus the rowtime.</p> <pre><code class="language- ">CREATE TABLE axis_events_hopping_5s_1s_ts \ WITH (kafka_topic = 'axis_events_hopping_5s_1s_ts') AS \ SELECT rowtime AS timestamp, * \ FROM axis_events_hopping_5s_1s; </code></pre> <p>And now, when we query this table we can see we have all the columns we need.</p> <pre><code>ksql&gt; select timestamp, axis, event_count from axis_events_hopping_5s_1s_ts; 1508761027000 | RotationZ | 61 1508761028000 | RotationZ | 61 1508761029000 | RotationZ | 61 1508761030000 | RotationZ | 61 1508761031000 | RotationZ | 61 1508761028000 | Y | 47 1508761029000 | Y | 47 1508761030000 | Y | 47 1508761031000 | Y | 47 1508761032000 | Y | 47 1508761029000 | X | 106 1508761030000 | X | 106 1508761031000 | X | 106 1508761032000 | X | 106 1508761033000 | X | 106 </code></pre> <p>This is the resulting graph in Grafana with each axis stacked on top of each other giving a visual representation of the total number of events overall and total per axis. The idea here being that if you can drive a lap with less overall inputs or <em>events</em> then the lap time should be faster.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/events_by_axis-7.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <h1 id="calculatinglaptimes">Calculating Lap Times</h1> <p>To calculate lap times, I needed a way of capturing the time difference between 2 separate events in a stream. Remember that the raw data is coming directly from the device and has no concept of lap, lap data is handled by a game engine. <br> I needed a way to inject an event into the stream when I crossed the start/finish line of any given race track. To achieve this, I modified the custom producer to increment a counter every time the X button was pressed and added a new field to the JSON message called <code>lap_number</code>. </p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/newlap-5.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>I then needed to recreate my source stream and my initial derived stream to include this new field</p> <p>New source stream</p> <pre><code>CREATE STREAM raw_axis_inputs ( \ event_id BIGINT, \ timestamp BIGINT, \ lap_number BIGINT, \ axis VARCHAR, \ value DOUBLE ) \ WITH (kafka_topic = 'raw_axis_inputs', value_format = 'JSON'); </code></pre> <p>New derived stream.</p> <pre><code>CREATE STREAM axis_inputs WITH (kafka_topic = 'axis_inputs') AS \ SELECT event_id, \ timestamp, \ lap_number, \ axis, \ value \ FROM raw_axis_inputs \ WHERE axis != 'Buttons5' OR value != 0.0; </code></pre> <p>Now when I query the <code>axis_inputs</code> stream and press the <code>X</code> button a few times we can see an incrementing lap number.</p> <pre><code>ksql&gt; SELECT timestamp, lap_number, axis, value FROM axis_inputs; 1508762511506 | 6 | X | 32906.0 1508762511553 | 6 | X | 32907.0 1508762511803 | 6 | X | 32909.0 1508762512662 | 7 | Buttons5 | 128.0 1508762513178 | 7 | X | 32911.0 1508762513256 | 7 | X | 32913.0 1508762513318 | 7 | X | 32914.0 1508762513381 | 7 | X | 32916.0 1508762513459 | 7 | X | 32918.0 1508762513693 | 7 | X | 32919.0 1508762514584 | 8 | Buttons5 | 128.0 1508762515021 | 8 | X | 32921.0 1508762515100 | 8 | X | 32923.0 1508762515209 | 8 | X | 32925.0 1508762515318 | 8 | X | 32926.0 1508762515678 | 8 | X | 32928.0 1508762516756 | 8 | X | 32926.0 1508762517709 | 9 | Buttons5 | 128.0 1508762517756 | 9 | X | 32925.0 1508762520381 | 9 | X | 32923.0 1508762520709 | 9 | X | 32921.0 1508762520881 | 10 | Buttons5 | 128.0 1508762521396 | 10 | X | 32919.0 1508762521568 | 10 | X | 32918.0 1508762521693 | 10 | X | 32916.0 1508762521803 | 10 | X | 32914.0 </code></pre> <p>The next step is to calculate the time difference between each "Buttons5" event (the X button). This required 2 new tables. The first table below captures the latest values using the <code>MAX()</code> function from the <code>axis_inputs</code> stream where the <code>axis = 'Buttons5'</code></p> <pre><code>CREATE TABLE lap_marker_data WITH (kafka_topic = 'lap_marker_data') AS \ SELECT axis, \ MAX(event_id) AS lap_start_event_id, \ MAX(timestamp) AS lap_start_timestamp, \ MAX(lap_number) AS lap_number \ FROM axis_inputs \ WHERE axis = 'Buttons5' \ GROUP BY axis; </code></pre> <p>When we query this table, a new row is displayed every time the X button is pressed, reflecting the latest values from the stream.</p> <pre><code>ksql&gt; SELECT axis, lap_start_event_id, lap_start_timestamp, lap_number FROM lap_marker_data; Buttons5 | 4692691 | 1508763302396 | 15 Buttons5 | 4693352 | 1508763306271 | 16 Buttons5 | 4693819 | 1508763310037 | 17 Buttons5 | 4693825 | 1508763313865 | 18 Buttons5 | 4694397 | 1508763317209 | 19 </code></pre> <p>What we can now do is join this table to a new stream.</p> <pre><code>CREATE STREAM lap_stats WITH (kafka_topic = 'lap_stats') AS \ SELECT l.lap_number as lap_number, \ l.lap_start_event_id, \ l.lap_start_timestamp, \ a.timestamp AS lap_end_timestamp, \ (a.event_id - l.lap_start_event_id) AS lap_events, \ (a.timestamp - l.lap_start_timestamp) AS laptime_ms \ FROM axis_inputs a LEFT JOIN lap_marker_data l ON a.axis = l.axis \ WHERE a.axis = 'Buttons5'; Message ---------------- Stream created ksql&gt; describe lap_stats; Field | Type --------------------------------------- ROWTIME | BIGINT ROWKEY | VARCHAR (STRING) LAP_NUMBER | BIGINT LAP_START_EVENT_ID | BIGINT LAP_START_TIMESTAMP | BIGINT LAP_END_TIMESTAMP | BIGINT LAP_EVENTS | BIGINT LAPTIME_MS | BIGINT </code></pre> <p>This new stream is again based on the <code>axis_inputs</code> stream where the <code>axis = 'Buttons5'</code>. We are joining it to our <code>lap_marker_data</code> table which results in a stream where every row includes the current <em>and</em> previous values at the point in time when the X button was pressed.</p> <p>A quick query should illustrate this (I've manually added column heading to make it easier to read)</p> <pre><code>ksql&gt; SELECT lap_number, lap_start_event_id, lap_start_timestamp, lap_end_timestamp, lap_events, laptime_ms FROM lap_stats; LAP START_EV START_TS END_TS TOT_EV LAP_TIME_MS 36 | 4708512 | 1508764549240 | 1508764553912 | 340 | 4672 37 | 4708852 | 1508764553912 | 1508764567521 | 1262 | 13609 38 | 4710114 | 1508764567521 | 1508764572162 | 1174 | 4641 39 | 4711288 | 1508764572162 | 1508764577865 | 1459 | 5703 40 | 4712747 | 1508764577865 | 1508764583725 | 939 | 5860 41 | 4713686 | 1508764583725 | 1508764593475 | 2192 | 9750 42 | 4715878 | 1508764593475 | 1508764602318 | 1928 | 8843 </code></pre> <p>We can now see the time difference, in milliseconds ( <code>LAP_TIME_MS</code> ), between each press of the X button. This data can now be displayed in Grafana.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/lap_times-7.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <p>The data is also being displayed along the top of the dashboard, aligned above the other graphs, as a <em>ticker</em> to help visualize lap boundaries across all axes.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/lap_markers-7.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <h1 id="anomalydetection">Anomaly Detection</h1> <p>A common use case when performing real-time stream analytics is Anomaly Detection, the act of detecting unexpected events, or outliers, in a stream of incoming data. Let's see what we can do with KSQL in this regard.</p> <h2 id="drivinglikealunatic">Driving Like a Lunatic?</h2> <p>As mentioned previously, Smooth is Fast, so it would be nice to be able to detect some form of erratic driving. When a car oversteers, the rear end of the car starts to rotate around a corner faster than you'd like, to counteract this motion, quick steering inputs are required to correct it. On a smooth lap you will only need a small part of the total range of the steering wheel to safely navigate all corners, when you start oversteering you will need make quick, but wider use of the total range of the wheel to keep the car on the track and prevent crashing.</p> <p>To try and detect oversteer we need to create another KSQL table, this time based on the <code>steering_inputs</code> stream. This table counts steering events across a very short hopping window. Events are counted only if the rotation exceeds 180 degrees (sharp left rotation) or is less than -180 degrees (sharp right rotation)</p> <pre><code>CREATE TABLE oversteer WITH (kafka_topic = 'oversteer') AS \ SELECT axis, \ COUNT(*) \ FROM steering_inputs \ WINDOW HOPPING (SIZE 100 MILLISECONDS, ADVANCE BY 10 MILLISECONDS) \ WHERE value &gt; 180 or value &lt; -180 \ GROUP by axis; </code></pre> <p>We now create another table that includes the timestamp for InfluxDB.</p> <pre><code>CREATE TABLE oversteer_ts WITH (kafka_topic = 'oversteer_ts') AS \ SELECT rowtime AS timestamp, * \ FROM oversteer; </code></pre> <p>If we query this table, while quickly rotating the wheel in the range <code>value &gt; 180 or value &lt; -180</code>, we can see multiple windows, 10ms apart, with a corresponding count of events.</p> <pre><code>ksql&gt; SELECT * FROM oversteer_ts; 1508767479920 | X : Window{start=1508767479920 end=-} | 1508767479920 | X | 5 1508767479930 | X : Window{start=1508767479930 end=-} | 1508767479930 | X | 10 1508767479940 | X : Window{start=1508767479940 end=-} | 1508767479940 | X | 15 1508767479950 | X : Window{start=1508767479950 end=-} | 1508767479950 | X | 20 1508767479960 | X : Window{start=1508767479960 end=-} | 1508767479960 | X | 25 1508767479970 | X : Window{start=1508767479970 end=-} | 1508767479970 | X | 30 1508767479980 | X : Window{start=1508767479980 end=-} | 1508767479980 | X | 35 1508767479990 | X : Window{start=1508767479990 end=-} | 1508767479990 | X | 40 1508767480000 | X : Window{start=1508767480000 end=-} | 1508767480000 | X | 45 1508767480010 | X : Window{start=1508767480010 end=-} | 1508767480010 | X | 50 1508767480020 | X : Window{start=1508767480020 end=-} | 1508767480020 | X | 50 1508767480030 | X : Window{start=1508767480030 end=-} | 1508767480030 | X | 50 1508767480040 | X : Window{start=1508767480040 end=-} | 1508767480040 | X | 50 1508767480050 | X : Window{start=1508767480050 end=-} | 1508767480050 | X | 50 1508767480060 | X : Window{start=1508767480060 end=-} | 1508767480060 | X | 47 1508767480070 | X : Window{start=1508767480070 end=-} | 1508767480070 | X | 47 1508767480080 | X : Window{start=1508767480080 end=-} | 1508767480080 | X | 47 1508767480090 | X : Window{start=1508767480090 end=-} | 1508767480090 | X | 47 1508767480100 | X : Window{start=1508767480100 end=-} | 1508767480100 | X | 47 </code></pre> <p>This data is plotted on the Y axis (we're talking graphs now) on the "Steering inputs" panel in Grafana. The oversteer metric can be seen in red and will spike when steering input exceeds 180 degrees in either direction.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/oversteer-6.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <h2 id="brakingtoohard">Braking too Hard?</h2> <p>Another anomaly I'd like to detect is when maximum brake pressure is applied for too long. Much like the brake pedal in a real car, the brake pedal I'm using has a very progressive feel, a fair amount of force from your foot is required to hit maximum pressure. If you do hit maximum pressure, it shouldn't be for long as you will most likely lock the wheels and skid off the race track, very embarrassing indeed.</p> <p>The first thing to do is to create a table that will store the last time maximum brake pressure was applied. This table is based on the brake_inputs stream and filters where the <code>value = 100</code></p> <pre><code>CREATE TABLE max_brake_power_time \ WITH (kafka_topic = 'max_brake_power_time') AS \ SELECT axis, \ MAX(timestamp) as last_max_brake_ts \ FROM brake_inputs \ WHERE value = 100 \ GROUP by axis; </code></pre> <p>A query of this table displays a new row each time maximum brake pressure is hit.</p> <pre><code>ksql&gt; SELECT axis, last_max_brake_ts FROM max_brake_power_time; Y | 1508769263100 Y | 1508769267881 Y | 1508769271568 </code></pre> <p>Something worth mentioning is that if I hold my foot on the brake pedal at the maximum pressure for any period of time, only one event is found in the stream. This is because the device only streams data when the state of an axis <em>changes</em>. If I keep my foot still, no new events will appear in the stream. I'll deal with this in a minute.</p> <p>Next we'll create a new stream based on the <code>brake_inputs</code> stream and join it to our <code>max_brake_power_time</code> table.</p> <pre><code class="language- ">CREATE STREAM brake_inputs_with_max_brake_power_time \ WITH ( kafka_topic = 'brake_inputs_with_max_brake_power_time') AS \ SELECT bi.value, \ bi.timestamp, \ mb.last_max_brake_ts, \ bi.timestamp - mb.last_max_brake_ts AS time_since_max_brake_released \ FROM brake_inputs bi LEFT JOIN max_brake_power_time mb ON bi.axis = mb.axis; </code></pre> <p>For each row in this stream we now have access to all columns in the <code>brake_inputs</code> stream plus a timestamp telling us when max brake power was last reached. With this data we create a new derived column <code>bi.timestamp - mb.last_max_brake_ts AS time_since_max_brake_released</code> which gives a running calculation of the difference between the current record timestamp and the last time maximum brake pressure was applied</p> <p>For example, when we query the stream we can see that maximum pressure was applied at timestamp <code>1508772739115</code> with a value of <code>100.0</code>. It's the row immediately <em>after</em> this row that we're are interested in <code>99.90234225 | 1508772740803 | 1508772739115 | 1688</code>. </p> <p>Again, I've manually added column headings to make it easier to read.</p> <pre><code>ksql&gt; SELECT value, timestamp, last_max_brake_ts, time_since_max_brake_released FROM brake_inputs_with_max_brake_power_time; BRAKE VALUE | TIMESTAMP | LAST MAX BRAKE TIME | TIME SINCE MAX BRAKE RELEASED 98.53513389 | 1508772739100 | 1508772733146 | 5954 98.82810711 | 1508772739100 | 1508772733146 | 5954 99.02342259 | 1508772739115 | 1508772733146 | 5969 99.51171129 | 1508772739115 | 1508772733146 | 5969 99.70702677 | 1508772739115 | 1508772733146 | 5969 100.0 | 1508772739115 | 1508772733146 | 5969 99.90234225 | 1508772740803 | 1508772739115 | 1688 99.51171129 | 1508772740818 | 1508772739115 | 1703 99.12108033 | 1508772740818 | 1508772739115 | 1703 97.65621423 | 1508772740818 | 1508772739115 | 1703 96.58197909 | 1508772740818 | 1508772739115 | 1703 95.41008621 | 1508772740818 | 1508772739115 | 1703 94.43350881 | 1508772740818 | 1508772739115 | 1703 93.65224689 | 1508772740818 | 1508772739115 | 1703 93.35927367 | 1508772740818 | 1508772739115 | 1703 92.87098496 | 1508772740834 | 1508772739115 | 1719 92.38269626 | 1508772740834 | 1508772739115 | 1719 91.11314564 | 1508772740834 | 1508772739115 | 1719 90.62485694 | 1508772740834 | 1508772739115 | 1719 90.42954146 | 1508772740834 | 1508772739115 | 1719 89.35530632 | 1508772740834 | 1508772739115 | 1719 87.89044022 | 1508772740834 | 1508772739115 | 1719 87.40215152 | 1508772740850 | 1508772739115 | 1735 86.52323186 | 1508772740850 | 1508772739115 | 1735 </code></pre> <p>Remember, that while an axis is held at the same value, 100.0 in this case, no more events will appear in the stream until the value changes again. This is why we are interested in the row preceding the maximum value, this row is telling us how long the value of 100.0 was applied for. In this case the time it was held for was 1688 milliseconds. Notice that on subsequent rows the value increases, but we are not interested in those rows. In order to isolate what we want, we need another table. This new table takes our previously created stream, <code>brake_inputs_with_max_brake_power_time</code> and groups it by the <code>last_max_brake_ts</code> column. For each grouping we then get the <code>MIN(time_since_max_brake_released)</code>. </p> <pre><code class="language- ">CREATE TABLE hard_braking WITH ( kafka_topic = 'hard_braking') AS \ SELECT last_max_brake_ts, \ MIN(time_since_max_brake_released) AS time_spent_at_max_brake_ms \ FROM brake_inputs_with_max_brake_power_time \ GROUP BY last_max_brake_ts; </code></pre> <p>When we query this table, while stepping hard on the brake pedal for a few seconds at a time, we get the information we want. We can see the timestamp for when maximum brake pressure reached and for how long it was sustained.</p> <pre><code>ksql&gt; SELECT last_max_brake_ts, time_spent_at_max_brake_ms FROM hard_braking; 1508775178693 | 1360 1508775178693 | 1360 1508775183334 | 1000 1508775183334 | 1000 1508775187709 | 422 1508775187709 | 422 1508775187709 | 422 1508775187709 | 422 1508775187709 | 422 1508775187709 | 422 1508775187709 | 422 1508775191256 | 1344 1508775191256 | 1344 1508775191256 | 1344 1508775195850 | 1687 1508775195850 | 1687 1508775195850 | 1687 1508775200662 | 1922 1508775200662 | 1922 1508775200662 | 1922 1508775200662 | 1922 </code></pre> <p>Here's what the above data looks like when visualised in Grafana. The bottom graph is showing <em>when</em> maximum brake pressure was hit and on for how <em>long</em> it was sustained. I've set a threshold against the graph of 1 second so any extreme braking is clearly identifiable - if you're that hard on the brakes for that long, you're probably going to end up in the scenery.</p> <p><img src="http://www.rittmanmead.com/blog/content/images/2017/10/max_braking-6.png" alt="Taking KSQL for a Spin Using Real-time Device Data"></p> <h1 id="thetaleof2laps">The Tale of 2 Laps</h1> <p>After putting it all together, it's time to take to the track and see how it looks. This video shows 2 complete laps onboard with the Caterham Seven 620R around Brands Hatch in the UK. The first lap is a relatively smooth one and the second is quite ragged. Notice that the first lap ( lap 68 ) is quicker overall than the second ( lap 69 ). On lap 69, I start to drive more aggressively and oversteer spikes start to appear in the steering input graph. Lap 69 also has significantly more events overall than lap 68 as a result my more exuberant ( slower ) driving style. You'll also notice that maximum brake pressure is reached a couple of times on each lap, but for no longer than the threshold of 1 second on each occurrence.</p> <iframe src="https://player.vimeo.com/video/240169902" width="640" height="360" frameborder="0" webkitallowfullscreen="" mozallowfullscreen="" allowfullscreen></iframe> <h1 id="summary">Summary</h1> <p>KSQL is awesome! Although it's only a developer preview at this point, it's impressive what you can get done with it. As it evolves over time and mirrors more of the functionality of the underlying <a href="https://docs.confluent.io/current/streams/developer-guide.html">Streams API</a> it will become even more powerful, lowering the barrier to entry for real-time stream processing further and further. Take a look at the <a href="https://github.com/confluentinc/ksql/blob/0.1.x/docs/roadmap.md#roadmap">road map</a> to see what may be coming next.</p> <p>Oh, and I recently discovered on the #KSQL <a href="https://slackpass.io/confluentcommunity">community Slack group</a>, that you can execute KSQL in <a href="https://github.com/confluentinc/ksql/blob/0.1.x/ksql-examples/src/main/java/io/confluent/ksql/embedded/EmbeddedKsql.java">Embedded Mode</a> right inside your Java code, allowing you to mix the native Streams API with KSQL - very nice indeed !</p> Tom Underhill aa39ce7a-1d16-4fce-83c0-a70e3c1d5944 Tue Nov 07 2017 07:41:22 GMT-0500 (EST)