Error in iTunes XML Parsing

[PGutbrod]

Get this in the log:

2006-09-14 16:30:27: err adding playlist Filme
2006-09-14 16:30:58: err adding playlist Musik
2006-09-14 16:31:55: err adding playlist Zuletzt hinzugefügt
2006-09-14 16:31:57: Could not start enum: Invalid playlist id: 1052
2006-09-14 16:41:50: Rendezvous socket closed (daap server crashed?) Aborting.

iTunes 7 with latest nightly.

Any ideas.

Peter Gutbrod

[M@rk]

I’d suspect iTunes 7.

Was it OK before you updated iTunes?

[Anonymous]

if it is itunes 7 messing you up then check out jturner22’s post on the 2nd page of this thread – it’ll take back you back itunes 6

http://www.rokulabs.com/forums/viewtopic.php?t=9026&postdays=0&postorder=asc&start=15

[rpedde]

@PGutbrod wrote:

Get this in the log:

2006-09-14 16:30:27: err adding playlist Filme
2006-09-14 16:30:58: err adding playlist Musik
2006-09-14 16:31:55: err adding playlist Zuletzt hinzugefügt
2006-09-14 16:31:57: Could not start enum: Invalid playlist id: 1052
2006-09-14 16:41:50: Rendezvous socket closed (daap server crashed?) Aborting.

iTunes 7 with latest nightly.

Any ideas.

Peter Gutbrod

It’s both. iTunes apparently now changes the playlist ids. Not sure why or how… I’ve seen it happen, but I couldn’t replicate it, and I wasn’t debugging at a high enough level to see for sure. :/

I’m still trying to track it down.

[PGutbrod]

@M@rk wrote:

I’d suspect iTunes 7.

Was it OK before you updated iTunes?

I assume it is iTunes 7. WIth iTunes 6 and an older nightly it worked.

Peter

[PGutbrod]

@rpedde wrote:

@PGutbrod wrote:

Get this in the log:

2006-09-14 16:30:27: err adding playlist Filme
2006-09-14 16:30:58: err adding playlist Musik
2006-09-14 16:31:55: err adding playlist Zuletzt hinzugefügt
2006-09-14 16:31:57: Could not start enum: Invalid playlist id: 1052
2006-09-14 16:41:50: Rendezvous socket closed (daap server crashed?) Aborting.

iTunes 7 with latest nightly.

Any ideas.

Peter Gutbrod

It’s both. iTunes apparently now changes the playlist ids. Not sure why or how… I’ve seen it happen, but I couldn’t replicate it, and I wasn’t debugging at a high enough level to see for sure. :/

I’m still trying to track it down.

It is probably due to the new categories Music, Movies etc. I do not have setup a playlist named “Filme” or “Musik”, they are just the German translation from these new auto categories. In iTunes 7 they do not show up under playlists but under library. Somehow mt-daap misinterprets these as playlists while parsing the XML.

Peter

[rpedde]

@PGutbrod wrote:

It is probably due to the new categories Music, Movies etc. I do not have setup a playlist named “Filme” or “Musik”, they are just the German translation from these new auto categories. In iTunes 7 they do not show up under playlists but under library. Somehow mt-daap misinterprets these as playlists while parsing the XML.

the actual cause of the crash was that itunes asked for a playlist that didn’t exist anymore. I don’t have incrmental updates, so it’s possible you can catch the database in an inconsistant state.

It *should* just return no items, but clearly I have a problem somewhere. That’s unrelated to the “changing playlist ids” thing.

— Ron

[PGutbrod]

It is a bit weird. Now I do not get any playlists out of the iTunes XML file.

Starting with a clean database and searching a level 9 log file for “playlist”, I stepped over the following:

2006-09-20 12:26:12 (b7d976c0): Found /home/itunes/iTunes/.DS_Store
2006-09-20 12:26:12 (b7d976c0): Found /home/itunes/iTunes/iTunes Music Library.xml
2006-09-20 12:26:12 (b7d976c0): Skipping playlist /home/itunes/iTunes/iTunes Music Library.xml (process_m3u)
2006-09-20 12:26:12 (b7d976c0): Found /home/itunes/iTunes/:2eDS_Store
2006-09-20 12:26:12 (b7d976c0): Found /home/itunes/iTunes/.AppleDouble
2006-09-20 12:26:12 (b7d976c0): Skipping appledouble folder
2006-09-20 12:26:12 (b7d976c0): Found /home/itunes/iTunes/._iTunes Music Library.xml
2006-09-20 12:26:12 (b7d976c0): Found /home/itunes/iTunes/._iTunes Library
2006-09-20 12:26:12 (b7d976c0): Ending song scan
2006-09-20 12:26:12 (b7d976c0): Executing: commit transaction
2006-09-20 12:26:12 (b7d976c0): Rows: 0
2006-09-20 12:26:12 (b7d976c0): Executing: pragma synchronous=normal
2006-09-20 12:26:12 (b7d976c0): Rows: 0
2006-09-20 12:26:12 (b7d976c0): Executing: create index idx_path on songs(path,idx)
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: delete from config where term=’rescan’
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: pragma synchronous = off
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: begin transaction
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Processing playlists
2006-09-20 12:26:13 (b7d976c0): Starting playlist scan
2006-09-20 12:26:13 (b7d976c0): Finished playlist loop
2006-09-20 12:26:13 (b7d976c0): Executing: end transaction
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: pragma synchronous=normal
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: create index idx_songid on playlistitems(songid)
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: create index idx_playlistid on playlistitems(playlistid,songid)
2006-09-20 12:26:13 (b7d976c0): Rows: 0
2006-09-20 12:26:13 (b7d976c0): Executing: select count(*) from playlists
2006-09-20 12:26:13 (b7d976c0): Executing: select * from playlists
2006-09-20 12:26:13 (b7d976c0): Executing: update playlists set items=(select count(*) from playlistitems where playlistid=1) where id=1

The line:
Skipping playlist /home/itunes/iTunes/iTunes Music Library.xml (process_m3u)

looks strange. Seems Firefly doesn’t parse the XML file any more.

Any ideas what is wrong?

Probably I messed up the configuration file, as the binary installation of Firefly on Mac OSX accessing the same Music Library on the Linux box remotely over SMB works fine and shows all the playlists.

Peter

[PGutbrod]

Answering my own silly question:
“Process .m3u Files” must be set to yes to make Firefly process the XML.
Well, I find this a bit misleading (.xml is not .m3u) but now the playlists show up again.

There is still the issue, that songs with special characters are missing in the playlists:
Here again my setup:
Music Library on a Linux box, managed from iTunes on a Mac over SMB.

2 Scenarios:
a) Firefly on the Mac accessing the Music Library over SMB: Everything works fine (but takes very long to connect to Firefly initially)
b) Firefly on the Linux box accessing the Music Library locally: Songs play well but all songs with special characters get dropped from playlists.

It obviously has something to do, that filenames with special characters look different whether accessed locally or over SMB. If anyone has a solution how to fix this, please leave a message.

As a lot of people use a NSLU with Firefly, I wonder, whether they have the same problem, if they manage their Library remotely via iTunes?

I’m thinking of just buying a second hand Mac Mini installing Firefly along with iTunes on it and replacing my Linuxbox as my Music Server, if I do not get this problem fixed.

Peter

[rpedde]

@PGutbrod wrote:

b) Firefly on the Linux box accessing the Music Library locally: Songs play well but all songs with special characters get dropped from playlists.

Yes. This is because the file system doesn’t do utf-8. Probably it’s latin1. All that needs to be done is a utf8->codepage conversion on the file lookups, but I need libiconv for that, so i didn’t do it until after a stable firefly was out.

I can add it now, and can probably trivially do that once I finish the daap module.

— Ron

p.s. You can probably manually iconv the itunes music library.xml from utf-8 to latin1 as a quick workaround.

[Author]

Posts