I’ve just published ActiveWarehouse 0.2.0 and ActiveWarehouse-ETL
0.5.1 releases. There’s a slew of new functionality in both libraries.
AW now supports Type 2 Slowly Changing Dimensions (thanks Seth) as
well as a new random data generator for populating your warehouse with
test data, fixes to some of the underlying queries (thanks Wenyi),
performance enhancements in aggregate generation and support for
overriding ordering for things like date (so even if you are
displaying the months of the year, for example, you can sort by
another column, such as an actual SQL date column.
AW-ETL now has SAX parser integration which dramatically improves XML
parsing in both speed and memory usage. The old XML parser integration
(which used DOM and XPath) will most likely be deprecated in favor of
the new SAX parser. You can also now pass a custom parser class for
the :parser option which is helpful if you do need a custom file
parser. The other biggie in AW-ETL is a new foreign key transformer.
The FK transformer is used to convert a natural key into a surrogate
key which references a dimension. The SAX parser combined with the FK
transformer means that basic fact population can now be done without
any custom parser authoring, which is quite nice. There are also a
number of small fixes in AW-ETL such as improved error handling,
better information printed to STDOUT when the processor is running and
more.
You can get the ActiveWarehouse update via
script/plugin install
svn://rubyforge.org/var/svn/activewarehouse/activewarehouse/tags/release-0.2.0
or from the trunk at
script/plugin install
svn://rubyforge.org/var/svn/activewarehouse/activewarehouse/trunk
and you can get the AW-ETL release with:
sudo gem install activewarehouse-etl
Both releases are also available for download at
http://rubyforge.org/frs/?group_id=2435
Enjoy!
–
Cell: 808 782-5046
Current Location: Melbourne, FL