Apache Spark Parallelism and Financial Analytics

This week we continue the Apache Spark usefulness and limitations for financial analytics. Last week we discussed input data formats. This week we focus on consolidation of financial data. Indexed access typically helps when searching for single answer to a question, be it a search engine query URL, or an individual financial transaction or balance. This compute pattern utilizes parallelism very effectively. But many types … Continue reading Apache Spark Parallelism and Financial Analytics

Apache Spark IO and Index Access

In the next three week’s episodes of Conversations with Kip, I focus on Apache Spark, a technology that recognizes the power of scanning large transactional data sets to produce analytical outputs. This week we focus on the Input Processes for analytical processes. The larger the amounts of data we can scan efficiently and quickly, the greater our potential analytics. Yet the scan process can be … Continue reading Apache Spark IO and Index Access

Customer Profitability: A Conversation with Ewan Puckle Hobbs

For the last five years, I’ve talked about issues I was taught about by Ewan Puckle Hobbs; specifically measurement of major enterprise transformations, or more directly customer profitability. He helped broaden my perspective from simply accounting processes to wider sets of measurement activities. A core part of this problem is capturing cost of customer activities. Capturing revenue by customer is not typically too hard–customer pay … Continue reading Customer Profitability: A Conversation with Ewan Puckle Hobbs

A Mentor Memorial: Douglas F. Kunkel

December 5th 2017 marks the five year passing of my good friend and a mentor Doug Kunkel. Doug was an unusual man in that he was a partner in a large, international accounting firm, but also wrote code–very good code, which is still used in major corporate financial systems. But more than what he achieved in a professional sense, Doug was also a great human … Continue reading A Mentor Memorial: Douglas F. Kunkel