Available now on SIRCA Gateway

Since our release of SIRCA Gateway we are pleased to share our latest updates, which include new custom functions, notebook examples and new data releases. For this month’s Gateway Tips and Tricks video we’ve focused on Australian Company Announcements.

Important reminder, our Legacy Portal will be decommissioned on 31 December 2017, please ensure you’ve registered for SIRCA Gateway. Please contact us here if you require any assistance with the registration process.

Morningstar monthly data is now available up to August 2017. The following Data Collections have been updated:
  1. Price (Market Capitalisation Database)
  2. Company Fundamentals
  3. Corporate Actions
  4. Returns
  5. Reference
  6. Company Ownership
  7. Corporate Governance
  8. Property
  9. Returns

ACA

Users of SIRCA’s Australian Company Announcements (ACA) service will be pleased to learn SIRCA has transferred the entire ACA collection to Gateway, where processing speeds are greatly reduced. The entire ACA collection can now be searched in a matter of minutes in Gateway. Boolean searching (AND, OR, NOT) within announcements is supported in Gateway, thanks to some clever behind the scenes Python programming, which only requires a user to specify the search criteria. A range of notebooks have been created and shared with all Gateway users, so everyone can quickly master the new methods – a Simple_Extraction notebook, which lets users make choices via a more traditional fixed format interface; a standard Notebook, demonstrating various common search requests in the very flexible Gateway manner; and an Advanced notebook, with an example where ACA targeted announcements are merged with intra-day prices to supply the raw elements of an event study. We invite you to experiment for yourself with these sample notebooks and to experience the ease with which Gateway works with Australian Company Announcements. To access, register now.

ASX Broker Trades Service

  1. SIRCA’s new ASX Broker Trades Service provides the Course of Sales data on a T+3 basis, with broker specific information fully disclosed.
  2. It contains a complete record of every trade transaction on every instrument, which is invaluable for maintaining a complete market history.
  3. The Basis of Quotation information is also available in this Service. The data for the ASX Broker Trades Service commences from January 2017.

ASX Broker Trades Service are only available in SIRCA Gateway and not in the Legacy Portal. Click here to here to register for SIRCA Gateway.

A summary of the most recent changes include:

  1. Morningstar data collection updated for August.
  2. New ASX Broker Trade Data now included in our Price Data Collection.
  3. GetContent Feature available now for Australian Company Announcements.
  4. Australian Company Announcements (ACA) has been added to Gateway, including new features to facilitate deeper analysis.
  5. SIRCA Gateway now has ASX ITCH raw data in csv format which has been included within the Price data collection. This data source is not normalised, preserving the ITCH message as received from ASX. We are currently working on generating a full order book view.
  6. Bulk download function has been added.

Tip of the Month


Using the Metadata search in Company Announcement, users can download up to 120,000 records at a time. This means that users can practically download an entire years worth of announcements metadata or the metadata associated with a company’s results announcement for the entire history at one time.
This compares favourably to the limit of 5,000 records in the legacy portal. For more information, the ACA standard notebook in Gateway demonstrates how to use the Metadata search.

We have added short 2 minute videos covering the following:
  1. How to conduct a simple download with ACA.
  2. Creating a notebook in Gateway
  3. Using a notebook in Gateway
  4. Linking two data tables in Gateway
  5. Bulk download data

You can access them here.
In addition to our SIRCA Gateway Tips & Tricks we also have helpful SIRCA WebLearn tutorials, which will help you get started with SIRCA Gateway. Please click here to access the videos.

ASX Broker Trade Data

SIRCA Gateway now includes:
  1. SIRCA’s new ASX Broker Trades Service provides the Course of Sales data on a T+3 basis, with broker specific information fully disclosed.
  2. It contains a complete record of every trade transaction on every instrument, which is invaluable for maintaining a complete market history.
  3. The Basis of Quotation information is also available in this Service. The data for the ASX Broker Trades Service commences from January 2017.

Highlights of the Latest Gateway Release

SIRCA is pleased to announce the latest release of SIRCA Gateway, which includes a number of new custom functions, notebook examples and new datasets.

We have also added some new short training videos to help our researchers get the most out of the platform, which you can access and view in the SIRCA Gateway Tips and Tricks section here.


Morningstar monthly data is now available up to July 2017. The following Data Collections have been updated:
  1. Price (Market Capitalisation Database)
  2. Company Fundamentals
  3. Corporate Actions
  4. Returns
  5. Reference
  6. Company Ownership
  7. Corporate Governance
  8. Property
  9. Returns

We have introduced a new custom function to Company Announcements -GetContent. This function is an extension to the Metadata and Single Download Search functions that allow users to import the announcement text from their returned results into a dataframe to enable text analytics. Please refer to the Advanced ACA notebook which provides examples on how to use this feature.

This feature was introduced in response to user feedback that the ability to process text analytics would be useful. To that end, we have updated the Advanced notebook to showcase an example using the Harvard IV4 dictionary to perform sentiment analysis against Company Announcements. If you have any questions on how to use it, or if you wish to provide further feedback, please use this form to contact us.


A summary of the most recent changes include:
  1. Morningstar data collection updated for July.
  2. GetContent Feature available now for Australian Company Announcements.
  3. Australian Company Announcements (ACA) has been added to Gateway, including new features to facilitate deeper analysis.
  4. SIRCA Gateway now has ASX ITCH raw data in csv format which has been included within the Price data collection. This data source is not normalised, preserving the ITCH message as received from ASX. We are currently working on generating a full order book view.
  5. Bulk download function has been added.

The next Gateway release will feature:

  1. New ASX Broker Trade Data
  2. Morningstar August Data Release

We are here to help

If you would like any further assistance for Gateway we are more than happy to help. Please send us your query via the contact form or request a demonstration. Please note that we have video tutorials available here that are continually being updated and refreshed for each release to help you understand the platform.

Get Content Function

This SIRCA Gateway release includes:
  1. Morningstar data collection update for July.
  2. The ability to extract the content of Company announcement into a dataframe, without having to download all the data. This will also enable users to process the text data using python.
  3. A notebook to demonstrate how users can process text data from Company Announcements.

Available now in SIRCA Gateway

SIRCA Gateway now includes:

  1. Morningstar data collection update for July.
  2. The ability to extract the content of Company announcement into a dataframe, without having to download all the data. This will also enable users to process the text data using python.
  3. A notebook to demonstrate how users can process text data from Company Announcements.

We are here to help
We hope that you have watched some of the videos that were created to help you get started. If you haven’t, here’s the link. Please do not hesitate to contact us if you would like some assistance as we are here to help first time users as well as advanced. Please email us to request an online demonstration, or if you have any feedback on Gateway.

What’s new on SIRCA Gateway

  1. Australian Company Announcements (ACA) has been added to Gateway, including new features to facilitate deeper analysis.

  2. We now have three new Notebooks under ACA, including:

    a. ACA (Standard). All existing functionality has been migrated to Gateway, including the content and announcement header search, as well as the ability to selectively download or bulk download. The bulk download includes an index file, which is a feature that power users have asked SIRCA to retain. We have also included metadata download capability for users who only want to download the summary headline information without the pdf/text content.

    b. ACA (Simple Extraction). This includes a simple way to search announcements for those users who do not want to edit search scripts. This has been developed in response to users asking for an easy interface.

    c. ACA Advanced. This demonstrates the capability to use the python programming interface to join Company Announcements with Price data.


  3. SIRCA Gateway now has ASX ITCH raw data in csv format which has been included within the Price data collection. This data source is not normalised, preserving the ITCH message as received from ASX. We are currently working on generating a full order book view.


  4. Morningstar data collection update for July.

Australian Company Announcements

ACA (Standard) – All existing functionality has been migrated to Gateway, including the content and announcement header search, as well as the ability to selectively download or bulk download. The bulk download includes an index file, which is a feature that power users have asked SIRCA to retain. We have also included metadata download capability for users who only want to download the summary headline information without the pdf/text content.

SIRCA Gateway Release

SIRCA, the leading provider of data to academics in Australia and New Zealand, has announced the launch of a new collaborative analytics platform, SIRCA Gateway, to support researchers. The SIRCA Gateway will not only enable SIRCA members to access new and improved data sets, it offers advanced cloud-based tools to analyse vast amounts of information. It also lays the foundation to build new tools for teachers and students in undergraduate courses.

Please contact us if you wish to register for SIRCA Gateway.

SIRCA Gateway Release

SIRCA launches powerful new cloud analytics platform for its member community and selects Morningstar as a new data provider


SIRCA, the leading provider of data to academics in Australia and New Zealand, has announced the launch of a new collaborative analytics platform, SIRCA Gateway, to support researchers. The SIRCA Gateway will not only enable SIRCA members to access new and improved data sets, it offers advanced cloud-based tools to analyse vast amounts of information. It also lays the foundation to build new tools for teachers and students in undergraduate courses.

SIRCA’s vast collection of financial markets data, which is housed on the platform, has also been expanded. Consistent with our quest to continuously add to the data collection, our recent collaboration with Morningstar now makes available:
  • Company Fundamentals Data – sourced from Morningstar’s Global Equity Data feeds.
  • End of Day Prices and Corporate Actions information covering the United States, Australia & New Zealand – sourced from Morningstar’s Real-Time Market Data feeds.
  • Managed Investments Data for Australia and New Zealand – sourced from Morningstar’s renowned Fund Data feeds next release

SIRCA is delighted to be affiliated with Morningstar as their premium data provider. SIRCA will now be able to offer Morningstar’s data covering fundamentals, corporate actions, end of day pricing and, in future, Morningstar’s premium collection of funds data.

“We are delighted to see US and New Zealand data included in the offering given the relevance to our local researchers.” said Professor Henk Berkman from University of Auckland.

“We are excited about the collaboration with SIRCA, which provides the research community with access to high quality data on domestic companies and managed investments, along with a sub-set of our global coverage.”, said Heather Brilliant, CEO, Morningstar Australasia. “For many years, Morningstar has worked with universities in Australia and New Zealand and we are looking forward to continuing and extending that alongside SIRCA.”

The powerful analytics engine leveraging Big Data analytics product Databricks is another significant addition to the platform’s capabilities. The SIRCA Gateway now enables researchers to analyse data in the cloud with all the benefits that cloud computing brings. Powerful, cloud based processing combined with new data sets and tools will help researchers accelerate analytic processes, test hypothesis, and promote more effective collaboration wherever they are. Researchers will be able to join data sets, introduce external data sets, share their analysis and work collaboratively with members building a true global online academic community.

This initiative will also provide a clearer path to the commercialisation for academics whose research is often related to growing the economy or increasing the transparency of markets for end consumers. A number of different platforms were analysed. The cloud based one was chosen as it serves the needs of large data sets that academics need to analyse to deliver innovative research. SIRCA was conscious of the needs of Database Managers within the universities who support researchers to be able to rapidly create and combine analytic datasets without incurring the overhead of managing or running the infrastructure. David Sharp, CEO SIRCA says the new data and platform capabilities are a significant step forward in providing our research community economies of scale and ease of access to new data sets and compute power. The SIRCA Gateway platform also provides the teaching community with new flexible and efficient tools to make analytics easily accessible for students.

“The SIRCA Gateway is a further example of our pioneering culture as it connects best-of-breed data sets with serious compute power. It enables our subscribers to swiftly build and deploy advanced analytics solutions, and bridge the gap between raw data and insights. We look forward to presenting new and expanded data sets quickly and cost effectively to our community. SIRCA Gateway gives us the platform that empowers academics to conduct research studies more efficiently and more expansively.”
Academics will be able to research in ways never supported before. We did not want to restrict the researchers by giving a filtered view of data. Instead, we wanted to empower them to query data, discover insights, join datasets as their research demands. Researchers are demanding more as they leverage analytical languages like R, Python & Scala. Academics can choose from the extensive library of codes that exist in the open source community that facilitate quantitative analytics & machine learning. We want our users to have choice and use whatever tools they are familiar with. Professor Stephen Taylor, Head of Financial Accounting, UTS believes the SIRCA Gateway will be a key enabler of financial market research, and will be welcomed by our academic research community. After a preview of the new cloud based analytics platform Professor Taylor stated:

“The SIRCA Gateway provides a truly unique opportunity for anyone who wants better insight into large-scale and complex financial markets data. It not only provides new and extensive data sets, it allows researchers to save time, control their analytics using their preferred programming language, and collaborate more easily.”