CSV Import of wma files fails

Hello Folks
We have been running Omeka 1.5.3 for the past year or so and we have been uploading jpg files without any problems. We recently recorded some oral histories to host on our site but I am having problems successfully uploading them using the CSVImport.

The import does not fail but comes up with zero items imported and 0 rows skipped
The files are at the most 7 MB and there are only six of them.
Even though I didn't think it was going to fix the problem. I increased my upload_max_filesize and post_max_size size to 100 MB, and rebooted the server but it didn't resolve the issue.

I know the url I am using is correct because I am able to play the audio files using the url that is in the csv file that I was trying to upload.

At this point I am unsure what my problem is.

Please Help

The first thing to check is whether the file type is allowed in the admin settings. If in doubt, you can turn off all the filtering to allow any file through.

If that doesn't do the trick, could you post up a few sample lines of your CSV file and we'll look for quirks.

Thanks much for the reply. Iam sorry I had forgotten to mention that I did check there. Here is a list of the
Allowed File Extensions
aac,aif,aiff,asf,asx,avi,bmp,c,cc,class,css,divx,doc,docx,exe,gif,gz,gzip,h,ico,j2k,jp2,jpe,jpeg,jpg,m4a,mdb,mid,midi,mov,mp2,mp3,mp4,mpa,mpe,mpeg,mpg,mpp,odb,odc,odf,odg,odp,ods,odt,ogg, pdf,png,pot,pps,ppt,pptx,qt,ra,ram,rtf,rtx,swf,tar,tif,tiff,txt, wav,wax,wma,wmv,wmx,wri,xla,xls,xlsx,xlt,xlw,zip

Her is the list of
allowed file types
application/msword,application/ogg,application/pdf,application/rtf,application/vnd.ms-access,application/vnd.ms-excel,application/vnd.ms-powerpoint,application/vnd.ms-project,application/vnd.ms-write,application/vnd.oasis.opendocument.chart,application/vnd.oasis.opendocument.database,application/vnd.oasis.opendocument.formula,application/vnd.oasis.opendocument.graphics,application/vnd.oasis.opendocument.presentation,application/vnd.oasis.opendocument.spreadsheet,application/vnd.oasis.opendocument.text,application/x-ms-wmp,application/x-ogg,application/x-gzip,application/x-msdownload,application/x-shockwave-flash,application/x-tar,application/zip,audio/aac,audio/aiff,audio/mid,audio/midi,audio/mp3,audio/mp4,audio/mpeg,audio/mpeg3,audio/ogg,audio/wav,audio/wma,audio/x-aac,audio/x-aiff,audio/x-midi,audio/x-mp3,audio/x-mp4,audio/x-mpeg,audio/x-mpeg3,audio/x-mpegaudio,audio/x-ms-wax,audio/x-realaudio,audio/x-wav,audio/x-wma,image/bmp,image/gif,image/icon,image/jpeg,image/pjpeg,image/png,image/tiff,image/x-icon,image/x-ms-bmp,text/css,text/plain,text/richtext,text/rtf,video/asf,video/avi,video/divx,video/mp4,video/mpeg,video/msvideo,video/ogg,video/quicktime,video/x-ms-wmv,video/x-msvideo

Here is the csv file I was trying to import
Identifier Title Description Tags Subject Date Coverage Creator Source Language Format Original Format File1
PPLDOH_Palmatier_A_20130422_1_WMA Al Palmatier Oral History Interview, Part 1 Local resident Al Palmatier tells of seeing Eleanor Roosevely in the area, and the story of the day he met Franklin Roosevelt when the president was driving his car around Vallkill. Roosevelt, Schools Oral Histories 22-Apr-13 Poughkeepsie, Dutchess County, New York Al Palmatier Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_1_WMA.wma
PPLDOH_Palmatier_A_20130422_2_WMA Al Palmatier Oral History Interview, Part 2 Local resident Al Palmatier recalls the various businesses and markets he that frequented and worked for during his youth in Poughkeepsie. Main Street, Businesses, YMCA, Hotels Oral Histories 22-Apr-13 Poughkeepsie, Dutchess County, New York Al Palmatier Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_2_WMA.wma
PPLDOH_Palmatier_A_20130422_3_WMA Al Palmatier Oral History Interview, Part 3 Local resident Al Palmatier tells a of his days swimming in swimming holes and the local pool during his youth in Poughkeepsie. Oral Histories 22-Apr-13 Poughkeepsie, Dutchess County, New York Al Palmatier Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_3_WMA.wma
PPLDOH_Schneider_D_20130415_1_WMA Dudley Schneider Oral History Interview, Part 1 Local resident Dudley Schneider recalls the day in 1939 when his family took the Hudson River Dayliner up to Poughkeepsie. They dined at the Smith Brothers Tea Shop & visited Vassar College to admire the architecture. Businesses, Vassar College, Main Street, Trolleys Oral Histories 15-Apr-13 Poughkeepsie, Dutchess County, New York Dudley Schneider Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_1_WMA.wma
PPLDOH_Schneider_D_20130415_2_WMA Dudley Schneider Oral History Interview, Part 2 Local resident Dudley Schneider tells of the events of May 8, 1974, when, as an IBM employee, he watched the railroad bridge fire from the IBM campus. He also tells stories of working at IBM over the years. Poughkeepsie Railroad Bridge Oral Histories 15-Apr-13 Poughkeepsie, Dutchess County, New York Dudley Schneider Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_2_WMA.wma
PPLDOH_Schneider_D_20130415_3_WMA Dudley Schneider Oral History Interview, Part 3 Local resident Dudley Schneider recalls taking his children to the YMCA & participating in their 'Indian Guides & 'Indian Princesses' programs, as well as his memories of the Adriance Memorial Library. YMCA, Adriance, PPLD Oral Histories 15-Apr-13 Poughkeepsie, Dutchess County, New York Dudley Schneider Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_3_WMA.wma

Now, here is the file hosted on the Omeka server, and it works just fine
http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_1_WMA.wma

Thanks again

Am I missing the delimiters in that CSV you pasted? There don't appear to be any. Is the importer able to tell how many columns you have and allowing you to map them?

Hi John

The importer shows up with the proper amounts of columns

This is the file in its entirety

Identifier Title Description Tags Subject Date Coverage Creator Source Language Format Original Format File1
PPLDOH_Palmatier_A_20130422_1_WMA Al Palmatier Oral History Interview, Part 1 Local resident Al Palmatier tells of seeing Eleanor Roosevely in the area, and the story of the day he met Franklin Roosevelt when the president was driving his car around Vallkill. Roosevelt, Schools Oral Histories 22-Apr-13 Poughkeepsie, Dutchess County, New York Al Palmatier Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_1_WMA.wma
PPLDOH_Palmatier_A_20130422_2_WMA Al Palmatier Oral History Interview, Part 2 Local resident Al Palmatier recalls the various businesses and markets he that frequented and worked for during his youth in Poughkeepsie. Main Street, Businesses, YMCA, Hotels Oral Histories 22-Apr-13 Poughkeepsie, Dutchess County, New York Al Palmatier Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_2_WMA.wma
PPLDOH_Palmatier_A_20130422_3_WMA Al Palmatier Oral History Interview, Part 3 Local resident Al Palmatier tells a of his days swimming in swimming holes and the local pool during his youth in Poughkeepsie. Oral Histories 22-Apr-13 Poughkeepsie, Dutchess County, New York Al Palmatier Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_3_WMA.wma
PPLDOH_Schneider_D_20130415_1_WMA Dudley Schneider Oral History Interview, Part 1 Local resident Dudley Schneider recalls the day in 1939 when his family took the Hudson River Dayliner up to Poughkeepsie. They dined at the Smith Brothers Tea Shop & visited Vassar College to admire the architecture. Businesses, Vassar College, Main Street, Trolleys Oral Histories 15-Apr-13 Poughkeepsie, Dutchess County, New York Dudley Schneider Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_1_WMA.wma
PPLDOH_Schneider_D_20130415_2_WMA Dudley Schneider Oral History Interview, Part 2 Local resident Dudley Schneider tells of the events of May 8, 1974, when, as an IBM employee, he watched the railroad bridge fire from the IBM campus. He also tells stories of working at IBM over the years. Poughkeepsie Railroad Bridge Oral Histories 15-Apr-13 Poughkeepsie, Dutchess County, New York Dudley Schneider Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_2_WMA.wma
PPLDOH_Schneider_D_20130415_3_WMA Dudley Schneider Oral History Interview, Part 3 Local resident Dudley Schneider recalls taking his children to the YMCA & participating in their 'Indian Guides & 'Indian Princesses' programs, as well as his memories of the Adriance Memorial Library. YMCA, Adriance, PPLD Oral Histories 15-Apr-13 Poughkeepsie, Dutchess County, New York Dudley Schneider Poughkeepsie Public Library District en wma wma http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_3_WMA.wma

Okay, I guess it's just a tab-delimited file, then.

Here's another question: your URLs are all to a 192.168.x.x IP. Is the server you're loading these onto on the same network as the server hosting them? Your browser can get to them fine, but that just tells you that the computer you're browsing from is on the same network as those files.

If the server you're trying to import into is on a different network, those IPs wouldn't work from its perspective.

Hi

Regarding the network locations, yes we are all on the same network. I am able access the wma files from both our external IP, and internal IP from my PC
It is a CSV file, I was copying from the excel csv into this text box. Below is the file copied from notepad

Identifier,Title,Description,Tags,Subject,Date,Coverage,Creator,Source,Language,Format,Original Format,File1
PPLDOH_Palmatier_A_20130422_1_WMA,Al Palmatier Oral History Interview Part 1,Local resident Al Palmatier tells of seeing Eleanor Roosevely in the area and the story of the day he met Franklin Roosevelt when the president was driving his car around Vallkill.,Roosevelt Schools,Oral Histories,22-Apr-13,Poughkeepsie Dutchess County New York,Al Palmatier,Poughkeepsie Public Library District,en ,wma,wma,http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_1_WMA.wma
PPLDOH_Palmatier_A_20130422_2_WMA,Al Palmatier Oral History Interview Part 2,Local resident Al Palmatier recalls the various businesses and markets he that frequented and worked for during his youth in Poughkeepsie.,Main Street Businesses YMCA Hotels,Oral Histories,22-Apr-13,Poughkeepsie Dutchess County New York,Al Palmatier,Poughkeepsie Public Library District,en ,wma,wma,http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_2_WMA.wma
PPLDOH_Palmatier_A_20130422_3_WMA,Al Palmatier Oral History Interview Part 3,Local resident Al Palmatier tells a of his days swimming in swimming holes and the local pool during his youth in Poughkeepsie.,,Oral Histories,22-Apr-13,Poughkeepsie Dutchess County New York,Al Palmatier,Poughkeepsie Public Library District,en ,wma,wma,http://192.168.1.18/archive/files/OH1/PPLDOH_Palmatier_A_20130422_3_WMA.wma
PPLDOH_Schneider_D_20130415_1_WMA,Dudley Schneider Oral History Interview Part 1,Local resident Dudley Schneider recalls the day in 1939 when his family took the Hudson River Dayliner up to Poughkeepsie. They dined at the Smith Brothers Tea Shop & visited Vassar College to admire the architecture.,Businesses Vassar College Main Street Trolleys,Oral Histories,15-Apr-13,Poughkeepsie Dutchess County New York,Dudley Schneider,Poughkeepsie Public Library District,en ,wma,wma,http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_1_WMA.wma
PPLDOH_Schneider_D_20130415_2_WMA,Dudley Schneider Oral History Interview Part 2,Local resident Dudley Schneider tells of the events of May 8 1974 when as an IBM employee he watched the railroad bridge fire from the IBM campus. He also tells stories of working at IBM over the years.,Poughkeepsie Railroad Bridge,Oral Histories,15-Apr-13,Poughkeepsie Dutchess County New York,Dudley Schneider,Poughkeepsie Public Library District,en ,wma,wma,http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_2_WMA.wma
PPLDOH_Schneider_D_20130415_3_WMA,Dudley Schneider Oral History Interview Part 3,Local resident Dudley Schneider recalls taking his children to the YMCA & participating in their 'Indian Guides & 'Indian Princesses' programs as well as his memories of the Adriance Memorial Library.,YMCA Adriance PPLD,Oral Histories,15-Apr-13,Poughkeepsie Dutchess County New York,Dudley Schneider,Poughkeepsie Public Library District,en ,wma,wma,http://192.168.1.18/archive/files/OH1/PPLDOH_Schneider_D_20130415_3_WMA.wma

Hello Folks
Did you have any more ideas?
Thanks Much

I know you said both URLs work fine, but do you get any different results when using the 64.x.x.x versions instead of the 192.x.x.x ones?

Hi John
I tried that with the 64.x.x.x same thing... What am I missing!
Everything has always worked fine with images on the server.

Import Date CSV File Item Count Status Action
2014-03-26 14:41:53 PPLDOH Descriptive Info.csv Imported: 0 / Skipped Rows: 0 / Skipped Items: 6 Completed

When you look at the detailed staus for that import, are there any logged messages?

Usually, skipped items that have URLs are down to the server, for whatever reason, not being able to download the files.

Hi John
We may be getting closer here.... Here is the errors.log report. I thought I had already checked and showed the acceptable MIMe type though earlier in this thread...

2014-03-26T15:10:03-04:00 DEBUG (7): [CsvImport] Started import at: Mar 26, 2014 3:10:03 PM
2014-03-26T15:10:03-04:00 DEBUG (7): [CsvImport] Item import loop started at: Mar 26, 2014 3:10:03 PM
2014-03-26T15:10:03-04:00 DEBUG (7): [CsvImport] Memory usage: 23924000
2014-03-26T15:10:04-04:00 INFO (6): [CsvImport] Error occurred when attempting to ingest the following URL as a file: 'http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_1_WMA.wma': The file 'http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_1_WMA.wma' could not be ingested because it has a disallowed MIME type (application/octet-stream).
2014-03-26T15:10:05-04:00 INFO (6): [CsvImport] Error occurred when attempting to ingest the following URL as a file: 'http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_2_WMA.wma': The file 'http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_2_WMA.wma' could not be ingested because it has a disallowed MIME type (application/octet-stream).
2014-03-26T15:10:06-04:00 INFO (6): [CsvImport] Error occurred when attempting to ingest the following URL as a file: 'http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_3_WMA.wma': The file 'http://64.72.87.229/archive/files/OH1/PPLDOH_Palmatier_A_20130422_3_WMA.wma' could not be ingested because it has a disallowed MIME type (application/octet-stream).
2014-03-26T15:10:09-04:00 INFO (6): [CsvImport] Error occurred when attempting to ingest the following URL as a file: 'http://64.72.87.229/archive/files/OH1/PPLDOH_Schneider_D_20130415_1_WMA.wma': The file 'http://64.72.87.229/archive/files/OH1/PPLDOH_Schneider_D_20130415_1_WMA.wma' could not be ingested because it has a disallowed MIME type (application/octet-stream).
2014-03-26T15:10:11-04:00 INFO (6): [CsvImport] Error occurred when attempting to ingest the following URL as a file: 'http://64.72.87.229/archive/files/OH1/PPLDOH_Schneider_D_20130415_2_WMA.wma': The file 'http://64.72.87.229/archive/files/OH1/PPLDOH_Schneider_D_20130415_2_WMA.wma' could not be ingested because it has a disallowed MIME type (application/octet-stream).
2014-03-26T15:10:15-04:00 INFO (6): [CsvImport] Error occurred when attempting to ingest the following URL as a file: 'http://64.72.87.229/archive/files/OH1/PPLDOH_Schneider_D_20130415_3_WMA.wma': The file 'http://64.72.87.229/archive/files/OH1/PPLDOH_Schneider_D_20130415_3_WMA.wma' could not be ingested because it has a disallowed MIME type (application/octet-stream).
2014-03-26T15:10:15-04:00 INFO (6): [CsvImport] Finished importing 0 items (skipped 0 rows).

Ah. I don't know why I didn't ask for that info right up front, because it really clarifies the issue.

Your server that's hosting Omeka isn't able to correctly identify those files as WMAs. It's just using the default "don't know" type of application/octet-stream, which isn't one of the allowed types.

If you have some control over the server, often updating the "file" library/program will get you a more updated database of heuristics for identifying the filetypes and can fix these problems.

Otherwise, you can work around it by temporarily disabling file MIME type validation in your site settings.

That did it John! You guys are awesome!
Thanks for the help...