SoundExchange Reporting Blog

Wow – it seems like we just finished up gathering data for the Q4 2009 SoundExchange reports. But don’t look now, because just five weeks from this Friday – that’s Friday, April 9, 2010 – is the deadline to get Public Interactive your Q1 2010 SoundExchange reporting data!

Here, again, are the basics, which hopefully folks are getting familiar with:

1. All reporting data must come from within Q1 2010, that is between the dates of January 1 – March 31, 2010.

2. Playlist log files that meet our formatting requirements are required from all stations that are not PI Composer Pro clients. Also, streaming log files are required from all stations that do not host their streams through Public Interactive.

3. Any data files that need to be provided to PI should be uploaded to us using Composer Pro or Basic. To do that, go to Upload Playlists/Streaming Logs under SoundExchange Dashboard in the global navigation.

4. Every station that doesn’t report on the full quarter must specify the start dates of their two chosen reporting weeks using the SoundExchange Dashboard in Composer Pro/Basic. To do that go to View Reports under SoundExchange Dashboard in the global navigation then click on Edit Report Dates for Q1 for each of your streams. Then uncheck the Disregard dates and use full quarter instead check box and use the date drop downs to specify the two starting dates of your chosen reporting weeks.

5. If your station streams Classical 24 you must enter or update the guide information in Composer Pro/Basic for each stream to properly reflect when you streamed C24 during your reporting period, so that we can integrate those playlists into your reports. To do that go to Create/Edit Program Guide under Program Guide Composer in the global navigation. NOTE: When adding the Classical 24 program in your guide, be sure to set the Program Format to Classical: C24.

If you have already uploaded files to us and have not yet confirmed with me that we got them and they are in the correct format LET ME KNOW! Call or email me and I will verify whether we received your files and if the formatting is correct.

If you are not a Composer Pro client of ours and do not yet have your Composer Basic login, let me know and I will give that to you.

Finally, not many folks have weighed in on what they might like to learn from all this data that we’re collecting for SoundExchange reporting. We’d like to be able to give back and share information with the system, but we need your input! Take a look at this post and add your ideas as a comment.

Onward!

During our session on SoundExchange reporting at the PRIMA conference in New Orleans last week, an excellent question was posed: does Public Interactive have any plans to share information that could be gleaned from all of the playlist and stream listenting data that we’re collecting for reporting purposes?

Yes, indeed, a most excellent question!

The short-term answer is we don’t have a plan yet for reporting such information, because we’ve been quite busy just reaching out to stations, gathering data, building our tools like Composer Pro, and generating the quarterly reports. The long-term answer is most definitely yes! We would love to report back information and statistics that would be of interest to the system.

Now that the question has been raised – and now that we’ve gotten our reporting legs under us, a bit – we would like to begin generating and sharing aggregate information based on the data we’ve gathered.

The obvious question, though, is, what do you people want to know?

To that end, we’d like to begin soliciting your input on what type of information based on SoundExchange reporting data should we report back to the system? If you have any ideas or suggestions, please add them as a comment to this post, so all can see what others are interested in. Once we get an idea of what kind of information folks are interested in, we’ll see about generating some reports that answer your questions.

Keep in mind the following parameters:

• We can only share aggregate statistics, meaning we cannot share data for any specific station. Stations, of course, have access to their own SX reports that we generate via Composer Basic or Pro.

• We have two types of data upon which to draw:
  • Playlists (potentially) include the following information for each song streamed:
    • Song Title
    • Featured Artist
    • Album Title
    • Marketing Label
    • Song play frequency/time of each play/Actual Total Performances (number of people that heard a song)
  • Streaming access logs includes information about stream listening, such as time and duration of listener sessions.

• We can also break things down by stream format, which is identified as one of the following:
  • Classical
  • Jazz
  • Music Mix
  • News and Information
  • News/Classical
  • News/Jazz
  • News/Music Mix
  • Adult Album Alternative

So, we can answer – or try to answer – questions like:

What’s the most frequently played piece of music on classical streams?

What song was heard by the most listeners?

What are the peak listening hours for AAA streams?

Etc., and so on.

Think about it, noodle on it, kick it around a bit and let us know what you’d like to learn from all this. Once we get some feedback, we’ll figure out what the popular questions are and do our best to provide some answers both now and going forward.

Many of you already know this – or should know this – but the deadline to submit your station’s Q4 2009 SoundExchange reporting data to Public Interactive is two days away – Friday, January 15, 2010!

We’re up to our eyes, ears, noses and throats here already in Q4 data from stations (thanks to everyone who has already submitted their data!) but there are still a lot of you from whom we haven’t heard – so let’s get that data to us!

Here one more time, for the record, are the reporting particulars:

1. All reporting data must come from within Q4 2009, that is between the dates of October 1 – December 31, 2009.

2. Playlist log files that meet our formatting requirements are required from all stations that are not PI Composer Pro clients. Also, streaming log files are required from all stations that do not host their streams through Public Interactive.

3. Composer Basic users must accept the Terms of Service before we can officially accept your data and generate reports.

4. Every station (both Composer Pro and Basic users) must specify the start dates of their two chosen reporting weeks using the SoundExchange Dashboard in Composer Pro or Basic.

5. All stations that stream Classical 24 must enter or update the guide information in Composer Pro/Basic for each stream to properly reflect when you streamed C24 during your reporting period, so that we can integrate those playlists into your reports.

6. You should upload your data to Public Interactive using the SoundExchange Dashboard screens in Composer Pro or Basic. If you are not a Composer Pro client of PI and have not yet received a login to Composer Basic contact me and I’ll send you your login.

If you have already uploaded files to us and have not yet confirmed with me that we got them and they are in the correct format LET ME KNOW ASAP! Call or email me and I will verify whether we received your files and if the formatting is correct.

That is all for now.

A new year has begun which, aside from meaning that we’re all little bit older (as my kids enjoy reminding me of frequently), also means that anther calendar quarter has ended for which SoundExchange reporting data are soon due.

What better way to begin a new year than by meeting legal requirements? I don’t know about you but nothing better comes to mind for me.

As you should know by now, the mechanics of reporting to SoundExchange through PI changed a bit from Q3 to Q4, mainly with the release of Composer Basic (and the renamed and revamped Composer Pro for our previous Composer clients). Here are the main points to keep in mind:

1. All reporting data from Q4 2009 (that is data from between the dates of October 1 – December 31, 2009) must be in the required format and submitted to Public Interactive  by COB Friday January 15, 2010, in order for us to guarantee that we can generate and submit reports to SoundExchange on your station’s behalf.

2. Playlist log files that meet our formatting requirements are required from all stations that are not PI Composer Pro clients. Also, streaming log files are required from all stations that do not host their streams through Public Interactive.

3. Composer Basic users must accept the Terms of Service before we can officially accept your data and generate reports.

4. Every station (both Composer Pro and Basic users) must specify their chosen reporting dates using the SoundExchange Dashboard in Composer Pro or Basic.

5. Stations that stream Classical 24 – again whether you are a Composer Pro or Basic user – must  update the guide information for each of your streams in Composer to properly reflect when you streamed C24 during your reporting period, so that we can integrate those playlists into your reports. IMPORTANT NOTE: When adding the Classical 24 program in your guide, be sure to set the Program Format to Classical: C24.

All stations that have registered with Public Interactive for SoundExchange reporting should now have a login to either Composer Pro or Composer Basic. If you do not, contact me and I’ll send you your login.

If you have already uploaded files to us, whether via FTP or Composer Pro/Basic and have not yet confirmed with me that we got them and they are in the correct format LET ME KNOW ASAP! We’re still working out the kinks in the new tools and don’t want anybody to fall through the cracks.

OK, let’s all start the year by being fully compliant! Thanks as always for your efforts.

Before 2009 waltzes out of our lives, allow us here at Public Interactive to say thanks to everyone for their efforts in the realm of SoundExchange reporting this year! We appreciate all the hard work by stations that have submitted data to us for reporting back to SoundExchange. We appreciate it, the CPB appreciates it and, believe it or not, SoundExchange appreciates it! Honest.

Before everyone disappears to drink egg nog and whatnot I wanted to remind folks about a few key things to keep in mind for submitting your Q4 data for SoundExchange reporting to us .

By now, everybody who has opted to be covered by the CPB-SoundExchange agreement and registered with Public Interactive for SoundExchange reporting should have access to the tools we have developed to make data submission easier. This includes both Composer Pro clients of ours, as well as Composer Basic users. If your station is not a PI Composer Pro client and has not yet received a login to Composer Basic, please contact me and I’ll get you set up.

Lots of detail on Composer Basic is available here, so I won’t rehash it all in this post. Here are some important things for everyone to keep in mind:

1. Data for Q4 reports must come from with October 1 – December 31, 2009 (i.e. the fourth calendar quarter). Basic information on the reporting data that you need to provide to us is available here.

2. Composer Pro clients don’t need to submit playlist logs to us (assuming they actually put playlist data into Composer Pro); however, if your streams are not hosted by Public Interactive you will still need to upload your streaming access logs to us. Composer Pro documentation is available here.

3. Composer Basic users will need accept the Terms of Service before we can officially accept your data and generate reports. You will then need to upload playlist log files to us, in addition to streaming access logs. Composer Basic documentation is available here; in addition a Composer Basic Quick Start Guide is available here.

4. Everyone, whether you are a Composer Pro or Basic client, must specify their chosen reporting dates using the SoundExchange Dashboard in Composer Pro/Basic. If you don’t we’ll assume that you are supplying us with a full quarter’s worth of data and will generate reports based on that assumption. To set your reporting dates in Composer Pro or Basic, go to View Reports, then click on Edit Report Dates for Q4 for each of your streams. Then uncheck the Disregard dates and use full quarter instead check box and use the date drop downs to specify the starting date of both of your chosen reporting weeks. Make sure to do that for all of your streams for which you are supplying reporting data.

5. Stations that stream Classical 24 – again whether you are a Composer Pro or Basic user – must  update the guide information for each of your streams in Composer to properly reflect when you streamed C24 during your reporting period. This is so we can integrate C24 playlists into your your station’s reports. In the future will be collecting and integrating playlists for other syndicated shows. IMPORTANT NOTE: When adding the Classical 24 program in your guide, be sure to set the Program Format to Classical: C24.

All of this (file uploads, setting reporting dates, accepting TOS, etc.) needs to be done by the deadline of Friday, January 15, 2010 in order for us to guarantee that we’ll be able to generate and submit Q4 reports on your station’s behalf.

That’s it for now! I’ll be out of the office starting Christmas day and will be back on Monday, January 4, 2010. In the meantime, feel free to submit your data to us using Composer Pro or Basic. Let me know that you have and I’ll review it – or answer any questions – when I get back.

Thanks again and Happy New Year to all and to all a good night – or day, you know, depending on when you read this.

I trust that everybody had a great Thanksgiving. I sure did! The last of the turkey leftovers was eaten last night. Always a sad moment when the bird is gone for good.

Speaking of turkeys, SoundExchange Q4 reporting data, as many of you know, is due to us here at Public Interactive by Friday January 15, 2010.

Here, again, are the relevant points to keep in mind:

1. Unless I have already told you otherwise, choose two 7-day consecutive periods within the quarter (October 1 – December 31, 2009) to report on. To repeat, your reporting data must must must be completely contained within Q4 or we cannot include it!

2. For each song streamed, the following information is required (yes, it is all required): song title, featured artist(s), album title, marketing label, start date and time, and EITHER end date and time OR duration of play.

3. Stations that are not Public Interactive Composer clients must submit a playlist log that matches our playlist file formatting requirements. Playlist files that do not match this format cannot be processed by us and will be rejected.

4. Stations that do not have their streams hosted by Public Interactive must submit streaming access logs that cover the chosen reporting period. Playlist logs alone are not sufficient; without streaming access logs (not aggregate usage statistics) we cannot generate reports on your station’s behalf.

This information should be old hat to many of you by now. Now, on to some new and exciting information!

This week we have begun rolling out changes to our Composer product to make data transfer, and managing of SoundExchange reporting information, easier. This involves two things:

1. Existing Public Interactive Composer clients were all upgraded earlier this week to Composer Pro! What is Pro? It’s the same Composer Program Guide and Playlist tools (with a new look), plus the new SoundExchange Dashboard. The Dashboard allows you to manage your contact and stream information with us for SX reporting, upload streaming log files (if your streams are not hosted with us), specify your quarterly reporting periods and access completed reports that we generate and submit to SX on your behalf.

If you haven’t already, please check out the Dashboard, review your contact and stream information and generally get familiar with it. An updated Composer Pro User Guide is also now available, detailing the changes.

2. A beta version of Composer Basic is now being shared with a handful of stations that are not PI clients. What is Basic? It includes the Composer Program Guide tool, for fletting us know what syndicated programming you stream, plus the new SoundExchange Dashboard. The Dashboard allows you to manage your contact and stream information with us for SX reporting, upload playlist and streaming log files, specify your quarterly reporting periods and access completed reports that we generate and submit to SX on your behalf.

This is the tool that the rest of you will use going forward which has a guide input tool to manage your weekly schedules, for the purpose of letting us know what syndicated programming you stream, as well as the SoundExchange Dashboard, which you will use to manage your contact and stream information with us for SX reporting, upload playlist and streaming log files, specify your quarterly reporting periods and access completed reports that we generate and submit to SX on your behalf.

If you’ve been lucky (or unlucky, depending on your point of view) enough to have been picked for beta testing, we appreciate your feedback and help!

We hope to make Composer Basic available to all stations who have registered with the CPB and PI for SoundExchange reporting in the next two weeks, so be on the lookout for an email from us with your login and connection instructions.

Thanks to those early bird stations that have already submitted their Q4 data, and to everyone for being patient with us as we build out these tools.

A big thanks to all you stations who submitted data for Q3 SoundExchange reports! It was a huge effort all the away around. We’re happy to say that we were ale to report on 175 stations, covering 230 separate content streams, which was a big jump from the Q2 reports (67 stations, 94 streams). We were happy, the CPB was happy and – most importantly – SoundExchange was happy by this upward trend. So, thank you all again.

As good as the Q3 turnout was, there is still much more to be done.

Stations that did not submit data for Q3 must start reporting; SoundExchange knows who you are and, while they have been understanding about everybody getting on board under the terms of the CPB-SoundExchange agreement, they expect every station streaming music to comply fully with the reporting requirements. I went to Washington, DC last week to meet with the folks at SoundExchange to update them on our progress and they made it clear that, in the not too distant future, they will begin knocking on doors of stations that are not in compliance. Please, please, please don’t be one of those stations.

OK, enough of that. You get the picture.

That brings us to the next order of business: Q4 reports!

In order to guarantee that we can generate and submit reports to SoundExchange on behalf of your station, you must submit your Q4 data to Public Interactive – in the required format (more on that below) – no later than Friday, January 15, 2010.

Here are the relevant points to keep in mind:

1. Unless I have already told you otherwise, choose two 7-day consecutive periods within the quarter (October 1 – December 31, 2009) to report on. To repeat, your reporting data must must must be completely contained within Q4 or we cannot include it!

2. For each song streamed, the following information is required (yes, it is all required): song title, featured artist(s), album title, marketing label, start date and time, and EITHER end date and time OR duration of play.

3. Stations that are not Public Interactive Composer clients must submit a playlist log that matches our playlist file formatting requirements. Playlists files that do not match this format cannot be processed by us and will be rejected.

4. Stations that do not have their streams hosted by Public Interactive must submit streaming access logs that cover the chosen reporting period. Playlist logs alone are not sufficient; without streaming access logs (not aggregate usage statistics) we cannot generate reports on your station’s behalf.

5. Depending on when your data is ready for submission, you will submit it to us either via FTP or Composer Basic. The latter is still not ready for general consumption, though we are working hard to make it available for Q4 data submissions. Either way, contact me when you are ready to submit your data and I will tell you how to do it.

Once more, just for the record, the deadline to get us your SoundExchange reporting data for Q4 (October 1 – December 31, 2009) is Friday, January 15, 2010. Learn it. Know it. Live it.

Of course, we are happy to accept your Q4 data well before January 15, if you have it available. Remember: if the data is not formatted properly we will ask you to reformat it and resubmit it to us. In order to ensure that we have your properly formatted data by January 15 it is best to get it to us as soon as you can.

This coming Friday, September 4, is not only the beginning of Labor Day weekend, but it also marks six weeks until the deadline to get your Q3 SoundExchange reporting data to Public Interactive – Friday, October 16, 2009.

It really sneaks up on you, doesn’t it? Kind of like old age.

Of course, we’ll be happy to take your reporting data before then, if you have it ready. Thanks to those stations that have already delivered their Q3 data to us!

As a reminder, here are the particulars about SoundExchange reporting through PI:

1. Make sure you have registered with the CPB, accepted the terms of the CPB-SX agreement, and registered with PI for SoundExchange reporting. If you have not completed all of these steps then PI cannot submit reports to SoundExchange on your behalf. If you are not sure whether your station has completed all of these steps, contact me and I can tell you.

2. Unless you have already been told otherwise, you choose two 7-day-consecutive periods within the current calendar quarter (July, August, September) on which to report. SoundExchange would like data for two weeks during which you play music that is representative of what you play during the whole quarter.

3. Prepare a data file of the songs you streamed during the reporting period (one file per content stream) that conforms to our playlist log file guidelines. Your playlist file(s) must conform to these basic requirements or we cannot process them and hence cannot generate and submit reports on your station’s behalf to SoundExchange! (NOTE: Existing PI Composer clients don’t need to send us a playlist log file, since we have access to your Composer data; just make sure you’ve filled out the playlist and guide data for your reporting weeks.)

4. Contact your IT department or stream host and request the raw streaming access logs that cover your chosen reporting weeks. Read more here about our streaming access log file guidelines, which describes what data we need. (NOTE: Existing PI streaming clients don’t need to send us streaming log access files.)

5. Once you are ready to send us your data files, if you do not already have an FTP account from PI, contact me and I will give you one to transfer the files to us.

6. Open a bottle of champagne to celebrate! You deserve it.

For those wondering, Composer Basic – an online tool that stations will use to manage stream information, push data files to PI and input schedule data (for use in incorporating syndicated programming playlists) – is not yet ready for prime time, so data uploads will continue to be via FTP. We’re hoping to have this tool online and available for stations before the end of the quarter.

Finally, for those going to the Public Radio Program Directors conference in a couple of weeks, please note that we will be having a session on SoundExchange reporting. If you’re going to be there be sure to attend and stop by the Public Interactive booth to say hello and ask questions.

As I have mentioned here before, we have posted guidelines for the formatting of playlist and streaming log files to be submitted to Public Interactive for SoundExchange reporting on this here blog. With the deadline for getting us your Q3 SoundExchange reporting data really not all that far off (seven weeks from Friday, but who’s counting?) – and since these guidelines have been tweaked a bit since first posted, I figured it was worth it to revisit these guidelines.

Streaming Access Log File Guidelines

Since, in general, streaming log files are produced by software applications (e.g. Windows Media, SHOUTcast, Icecast, Real, etc.) these really are just guidelines to make sure your server is logging the required data, since stations won’t generally have control over the formatting. We’re ready to work with the various formats produced by these tools, since there are only a handful of them that most stations use.

Playlist Log File Guidelines

Playlist log files, however, are another matter. These really are requirements, not just guidelines, in that we must have your data in a fairly specific format in order to make automated processing possible. Many stations track playlist data using a homegrown application or a spreadsheet, so it’s just not possible for us to try and accommodate the near infinite variety of possible data formats that could arise. For those that use commercial applications (e.g. Spinitron, MusicMaster, Liquid Compass, etc.) we have been working with the vendors where possible to communicate our formatting needs.

Please be sure to review our playlist file formatting requirements if you haven’t recently! If the data is not given to us in the required format we will not process it and won’t be able to submit reports on your behalf to SoundExchange.

Some of the finer points of the formatting to bear in mind:

• Files must be tab-delimited, text files (i.e. no spreadsheets, Word documents, PDFs, etc.)
• Please use the following exact field identifiers: Title, Artist, Album, Label, Start Time, End Time, Duration. Field ordering within the file doesn’t matter, so long as your are consistent throughout.
• Please do not include any other data in the playlist file, other than the header row and playlist entries (i.e. no schedule data)
• Start Time must include the date (i.e. one field for the start date and time, not two separate fields); same for End Time.
• Times must be in 24-hour format

If your station will be entering playlist data by hand, we have prepared an empty, sample spreadsheet that you could use as a starting point.

Download this sample playlist entry spreadsheet here.

It has all of the required fields (though remember that we only need either End Time OR Duration, not both), including the proper field headers, and formatting for start and end times. Once you enter your data you would simply choose to Save As a Tab Delimited text (.txt) file, which you can then send to Public Interactive. Voila!

These requirements are pretty well set now, but it’s possible we may tweak things if the need arises in the future. When and if that happens I will be sure to note it here in the blog. Thanks to everyone for your patience as we work the kinks out of this whole process.

I’ve just whipped up a couple of pages outlining the formatting guidelines for both playlist and raw streaming access log files.

I’ve include some sample files to download and use as guides.

Please take a look and feel free to contact me with any questions.