new Anime branch 2011-2012| bugs, errors and support

Discussion and support for lad1337's anime fork

new Anime branch 2011-2012| bugs, errors and support

Postby lad1337 » Mon Mar 14, 2011 5:06 am

***
this is the support thread for the "myAnime" branch at
http://github.com/lad1337/Sick-Beard/tree/anime
git://github.com/lad1337/Sick-Beard.git
issues can be added here: http://code.google.com/p/sickbeard-myanime/
***

! NOTHING IS WITH ANY WARRANTY IF YOU LOSE ANY DATA IT IS YOUR OWN FAULT !

features:
  • flag a show as anime
  • if the show is flaged as an anime the absolute numbering will be shown in the episode list
  • fanzub.com as a pure anime search provider with fake backlog
  • nzbmatrix support with backlog ! thanks to the code from darkcubes anime supporting branch !!( https://github.com/darkcube/Sick-Beard/ )
  • snatching and post processing
  • file parsing e.g. http://pastebin.com/7P7um8SY (will try to keep this up to date(ok i am not)), if you have any issue with a file that matches a naming type in the list pleas let me know!
  • dual episode support
  • snatching on manuel search and on automated search
  • adding the absolute number to the post processing name OR only absolute number
  • anidb file lookup during postproccessing (=pp). this increases the probability to successful recognise the given file.
  • add file to anidb mylist after / during a successful pp (optinal)
  • select your fansub group... you will get what you wanted
  • maybe more maybe less

we now have a google project to keep up with the issues : http://code.google.com/p/sickbeard-myanime/ please post issues there
a DEBUG log on http://www.pastebin.com would be awesome!

it is up to date with the master (most of the time)

known issues:

hopefully old issues:
  • no selection of a fansub group... you will get a random mix
  • fals recognising of some episodes as special episodes (is a bug due to special seasons being 0 and initial also being 0 ... i think)
  • no backlog
  • on dual episodes onyl the first one is recognising correctly second one is ignored
  • if the setting "move assisted files" is on ONLY associated files are move, you will loose your ep files
  • its late ... i dont now .. its buggy

known to be troublesome / not working animes:
  • show-name -> file-name-sheme ( -> pastebin log)
  • 5 Centimeters Per Second -> 5 Centimeters Per Second S01E03 HD TV.mkv
  • .hack//roots -> .hack roots s01e01 001.mkv
  • .hack//sign -> .hack Sign s01e01 001.mkv


howto:
  • pick "new install" OR "same installation"
  • follow the steps of chosen installation method
  • follow the steps for the config
  • post bugs and erros only !!
  • for features request post here: viewtopic.php?f=8&t=509

Install

try the new binaries at http://sickbeard.lad1337.de/ (choose the anime tab)

"new install" for testing:
this is the save way.
and you should use this if you have never installed sickbeard before on your computer !
but this can also be run side by side to your existing sickbeard

  • you will need to install cheetah the normal install guide should be helpfull : http://sickbeard.com/install.html
    and come back after you successfully did step 2
  • make a new folder wich should contain sickbeard
  • goto into the folder. terminal:
    Code: Select all
    cd <path to new folder>
  • get the code. terminal:
    Code: Select all
    git clone git://github.com/lad1337/Sick-Beard.git
  • wait a few seconds
  • a wild "SickBeard" folder will appear. cd into it. terminal:
    Code: Select all
    cd SickBeard
  • switch to the anime branch. terminal:
    Code: Select all
    git checkout -b anime origin/anime
  • check if it worked. terminal:
    Code: Select all
    git branch
    should look like
    Code: Select all
     master
    *anime
  • make sure the normal sickbeard installation isnt running or you will get some port errors (you can set the port later or directly in the config to have both runnning)
  • start sickbeard. terminal:
    Code: Select all
    python SickBeard.py


"same installation" with the power of git:
!!WARING!!
only use the following instructions if you know what git is and you know what you are doing
only works if you previously installed sickbeard through git
this might destroy all your sickbeard data and configs, although unlikely. (i will not help anyone who destroys his/hers sb installation )
  • kill sickbeard. i mean shut it off through the web interface
  • go into the sickbeard install folder. terminal:
    Code: Select all
    cd <sickbeard folder>
  • add my fork as a resource. terminal:
    Code: Select all
    git remote add lad1337 git://github.com/lad1337/Sick-Beard.git
  • download the code. terminal:
    Code: Select all
    git fetch sb_team
  • switch to the anime branch. terminal:
    Code: Select all
    git checkout -b anime lad1337/anime
  • start sickbeard. terminal:
    Code: Select all
    python SickBeard.py

config, after installation:
  • goto config->Search Providers and activate fanzub. save
[*]add the anime as normal (as new or as existing show)
[*]after sickbeard is done loading the anime go to the anime and edit the show setting
[*]set it as an anime. save
[*]if you added an existing show you might want to rescan the files (show->re-scan files)


if you want to update and you did the "new install method"
Code: Select all
git pull

or
Code: Select all
git pull master anime

should do the trick

if you did the "same installation" method
Code: Select all
git pull sb_team anime
should work

if you want to be up to date i suggest you either



if you choose the save/clean install method you have a clean new install of sickbeard with anime support
and with clean i mean sab config isnt made and post processing is done with the normal sickbeard, since the sickbeard url/port in the postprocess script is unchanged.
if you make sure that the new installation has the same url as your previous/normal installation pp will be fine( but you cant run both with sab)


thanks in advance

lad1337





  • UPDATE(2011-09-27 --:--): keeping this list up to date is a pain :/ ... look here https://github.com/lad1337/Sick-Beard/commits/myAnime to see what has changed and when .. however this thread is still active and live and stuff ^^

  • UPDATE(2011-08-31 --:--):... fix for the chache in combination with the bwl
  • UPDATE(2011-07-20 --:--): ... some stuff... i have been missing out writing the updates here... well its all a little smoother now ^^ (the fansub selection works pretty good ... )
  • UPDATE(2011-07-06 00:17): this this has a experimental fix ... well during searching the anime non anime switcher is now very strickt to prevent fals positives ! and i changed the version checker it will now check for the propper version :D ... if the sign with "there is a update" it is for real ^^
  • UPDATE(2011-06-28 14:50): merge with master and a bug fix (Post-processing settings not being remembered) and black and whitelist filtering, no gui yet only plain db entrys
  • UPDATE(2011-06-09 --:--): merge with master
  • UPDATE(2011-05-28 01:12): new feature: you can let sb add the successful pp file of an anime add it to the anidb mylist. there is a setting in the anime config. and some refactoring in the pp
  • UPDATE(2011-05-18 00:--): updated anidb connection tis should now always keep the connection. and some day earlier was a merge with master
  • UPDATE(2011-05-16 14:33): new anime config section. anib username and password are now setable in the gui. you might want to (re)enable anidb support!!
  • UPDATE(2011-05-12 11:51): we have anidb look up ! see viewtopic.php?f=4&t=1452&p=8953#p8953 for instructions
  • UPDATE(2011-05-04 --:--): we now have a google project to keep up with the issues : http://code.google.com/p/sickbeard-myanime/ please post issues there
  • UPDATE(2011-05-03 19:45): fix a special episode bug
  • UPDATE(2011-05-03 11:39): fix pp scene excepted shows... thanks to Ycros !
  • UPDATE(2011-05-03 11:35): anime scene exceptions support for fanzub... thanks to Ycros ... however the pp wont pick the new names... so for now scene exceptions are considered broken/now fully implemented by me
  • UPDATE(2011-04-30 12:03): anime scene exceptions
  • UPDATE(2011-04-26 --:--): merge with master
  • UPDATE(2011-04-20 11:04): some fixes and more and better file recognition, merge with master
  • UPDATE(2011-04-15 22:23): fix / feature pp with thetvdb lookup, merge with master
  • UPDATE(2011-04-14 23:23): complet refactoring of the parsing. and merge with master
  • UPDATE(2011-04-13 22:04): merge with master and see comment here https://github.com/lad1337/Sick-Beard/c ... eef230908c wich means SXXEXX (only) can be used for anime
  • UPDATE(2011-04-09 15:54): merge with master, fixed pp for files that contain [ or ] while "moving associated files" is on (this is a "master-bug")
  • UPDATE(2011-04-04 19:56): merge with master, huge update on the file scaning side, major rewrite of regex usage. have a look what it can parse here http://pastebin.com/7P7um8SY
  • UPDATE(2011-04-01 15:20): on the history page the fansub group of the download is shown for animes too !
  • UPDATE(2011-04-01 14:57): pseudo backlog. if you activate a backlog seach on a anime it pulls the last 1000 post for that show and searches for needed ep
  • UPDATE(2011-04-01 13:30): merge with master, feature: deactivate the S01E01 format for anime. preview of anime nameing. ATTENTION: please save the pp config to recalibrate the config.
  • UPDATE(2011-03-30 --:--): redone regex choosing,quality fix
  • UPDATE(2011-03-28 --:--): merge with master and some fixes (file scanning)
  • UPDATE(2011-03-27 15:12): merge with master
  • UPDATE(2011-03-26 11:06): merge with master
  • UPDATE(2011-03-23 11:00): merge with master and a fix for quality recognizing (i get much more results ^^)
  • UPDATE(2011-03-17 00:02): stuff, mainly regex ... oohh and merge with master so we are up to date again
  • UPDATE(2011-03-16 00:35): this verison brings some major changes. and a change in the database
    this will not work if you have previously installed this version by its own
    to make it work change the colum name "absolute_number" in the table tv_shows to "anime"
    the databse is the the sickbeard.db file
    OR
    if you dont care about the data in the database (because you are only testing right !?) delete it ^^
    sb will then create a new empty one
  • UPDATE(2011-03-14 17:57): last commit fixes pp (again). if pp fails try the update


future:
  • test bench! so we can verify i didnt break normal shows. will improve master branch acceptance
  • anidb(http://anidb.net/) support for different names per season, better episode list generating (in dev)
  • release group filter / wishlist / blacklist
  • timezone support although this might come from a diffrent branch and will just work for all shows / animes

-----current development (last update of this section: 2011-07-20)-----
roadmap:
milestone 1 (group selection) -> CHECK:
  • implement a black and whitelist (new branch that will be merged into myAnime and a pull request to the master) -> CHECK
  • adding new tables "white_list" and "black_list". columns: show_id, range, value -> CHECK
    • with type being "global" or a regex group … in our case "release_group" -> CHECK
    • filter found results by black and white list -> CHECK
  • implement a way to get the groups for an anime (adba -> GROUPSTATUS) -> CHECK
    • get the grouplist in the show edit page and add a selection for groups into the show edit page (multi lists) -> CHECK
    • save selected groups in white list with type "release_group" ->CHECK

milestone 2(community exceptions):
  • define functions and possibilities of community exceptions -> http://pastebin.com/MUpVdjXH
  • define database
  • define protocol
  • build server script
  • build sb integration

milestone 3(anidb info provider):
  • add anidb as a info provider
    • maybe some huge refactoring. modulating the the tvdb scraper for easier implementation for future info providers (e.g. tvrage)
    • lots of stuff!!

milestone 4(setup notifications):
  • add a "automatically setup notifications" in the anidb config
    • create the notifications while adding the show if "automatically setup notifications" is set
  • add a "setup notification" button in the show edit page

milestone 5(push search):
  • listen for notifications (adba)
  • handle notifications
    • push acknowledge notification (adba -> PUSHACK)
    • acknowledge notification (adba -> NOTIFYACK)
    • filter selected release group
    • create a custom search in sb based on the notification
    • possibly with a fixed delay
Last edited by lad1337 on Wed Apr 25, 2012 7:11 am, edited 68 times in total.
my anime branch: http://goo.gl/osNsn
support: http://goo.gl/4YUQF
issues: http://goo.gl/vdmse
##########
unofficial builds(win/osx)[normal/anime(/develp)]: http://sickbeard.lad1337.de/
##########
ImageImage
User avatar
lad1337
 
Posts: 413
Joined: Mon Mar 07, 2011 6:58 pm

Re: new Anime branch 2011, bugs and errors

Postby jfeeser » Tue Mar 15, 2011 10:38 am

I can't tell you how long i've been waiting for this. Thanks so much!

One quick question, as soon as i get it started the first time, i already get the "there's a new version (or you're ahead of master)" prompt. If i click to upgrade, will it respect that i'm on the myAnime branch, or will it overwrite it with the main branch? I always like having the latest changes, but i want to make sure i'm upgrading to the right thing.
jfeeser
 
Posts: 12
Joined: Mon Feb 07, 2011 2:17 pm

Re: new Anime branch 2011, bugs and errors

Postby lad1337 » Tue Mar 15, 2011 10:52 am

as far as i know the build in update method wont respect the diffrent branch
so if you klick the "update now" it might bring you back to the original without anime or do nothing or worse

i have not tried it ! and you should only do it if you are willing to risk it all !!

EDIT: howto update see first post at the very end
Last edited by lad1337 on Fri Apr 15, 2011 7:16 am, edited 1 time in total.
my anime branch: http://goo.gl/osNsn
support: http://goo.gl/4YUQF
issues: http://goo.gl/vdmse
##########
unofficial builds(win/osx)[normal/anime(/develp)]: http://sickbeard.lad1337.de/
##########
ImageImage
User avatar
lad1337
 
Posts: 413
Joined: Mon Mar 07, 2011 6:58 pm

Re: new Anime branch 2011, bugs and errors

Postby jfeeser » Wed Mar 16, 2011 7:10 am

One quick question/thought that came up as i was reorganizing my series...how are you going to handle series that have multiple seasons, where the subsequent seasons are called something different? Examples:

Season 1: Darker Than Black
Season 2: Darker Than Black - Twilight of the Gemini

Season 1: Code Geass
Season 2: Code Geass R2

Season 1: Black Lagoon
Season 2: Black Lagoon - The Second Barrage
Season 3: Black Lagoon - Roberta's Blood Trail

The second and third seasons of these shows are posted (usually) under the new series name, so Black Lagoon 2x01 is usually posted as "Black Lagoon - The Second Barrage 01", so the sickbeard engine won't find it, since it's either looking for episode 2x01, or Black Lagoon: Episode 14 if it's looking at it as an anime.

Can this be done with exceptions on a show-by-show basis? Or is this something i'm going to have to suck it up and do manually? ;)

-J
jfeeser
 
Posts: 12
Joined: Mon Feb 07, 2011 2:17 pm

Re: new Anime branch 2011, bugs and errors

Postby lad1337 » Wed Mar 16, 2011 7:28 am

maybe i can come up with a regular expression that can still find the "main" show in the post title without geting fals positives
but then it needs to check the "season extension" and see which season we want / we have
but we dont have a record of the different season names... for now
so this wont work

you cant even add Black Lagoon - The Second Barrage as its own show since thetvdb dosent have a record for it

exceptions are possible like a "season search name" or "alternative show search name"... but not welcomed by the dev team
and some piece of work !
maybe this can be done in conjunction with fansub group preferences

but a good point
i havent looked into it yet ... but i will
my anime branch: http://goo.gl/osNsn
support: http://goo.gl/4YUQF
issues: http://goo.gl/vdmse
##########
unofficial builds(win/osx)[normal/anime(/develp)]: http://sickbeard.lad1337.de/
##########
ImageImage
User avatar
lad1337
 
Posts: 413
Joined: Mon Mar 07, 2011 6:58 pm

Re: new Anime branch 2011, bugs and errors

Postby psikoh » Thu Mar 17, 2011 7:26 pm

I have a problem with this. Dunno if I've done something wrong or what, but i've tried it a few times...

It doesn't recognise existing episodes as the correct episode.
2011-03-18 09:57:25.649000 SHOWQUEUE-ADD :: Episode Y:\!Anime\Bleach\Season.04\Bleach.090.Abarai.Renji,.Soul.of.Bankai!.SD.TV.avi returned an exception: Couldn't find episode 0x90

And in the season view for ones that are found i get this:

Abs ep Name Air Date File Name
213 1 The Soul Burial Detective, Karakuraizer is Born 2009-03-31 Season.05\Bleach.101.Mayuri's.Bankai!.Sawatari-.Clash.of.the.Demon.SD.TV.avi

All my eps have come across like this...Any ideas?


Edit:
Also, post processing is adding the Season and ep number to the file name:
Season.10\Naruto.Shippuuden.S10E07.203.Sasuke's.Way.of.the.Ninja.SD.TV.mkv

I don't really care what season/ep number it is, is there a way to disable that?
psikoh
 
Posts: 10
Joined: Wed Oct 27, 2010 11:44 pm

Re: new Anime branch 2011, bugs and errors

Postby lad1337 » Fri Mar 18, 2011 6:00 am

edit: ok i tested it now with the exact name for the episode and it worked !
Code: Select all
Mär-18 14:34:09 DEBUG    SHOWQUEUE-REFRESH :: 74796: Creating episode object from /Users/lad1337/Azureus/Bleach/Season.04/Bleach.090.Abarai.Renji,.Soul.of.Bankai!.SD.TV.avi
Mär-18 14:34:09 DEBUG    SHOWQUEUE-REFRESH :: Using anime AND normal regex's
Mär-18 14:34:09 DEBUG    SHOWQUEUE-REFRESH :: 74796: /Users/lad1337/Azureus/Bleach/Season.04/Bleach.090.Abarai.Renji,.Soul.of.Bankai!.SD.TV.avi parsed to Bleach 0x90

did you flag Bleach as an anime ?? in the show edit page

a naming scheme like that isnt supported yet .... for anime
it matched it as a normal episode number and not absolute number
i will see to make this work !

@ edit: right now no ... i would be easy though but i "need" it for xbmx but the option will come

but are you telling me that it snatched and downloaded it ? :)
my anime branch: http://goo.gl/osNsn
support: http://goo.gl/4YUQF
issues: http://goo.gl/vdmse
##########
unofficial builds(win/osx)[normal/anime(/develp)]: http://sickbeard.lad1337.de/
##########
ImageImage
User avatar
lad1337
 
Posts: 413
Joined: Mon Mar 07, 2011 6:58 pm

Re: new Anime branch 2011, bugs and errors

Postby psikoh » Fri Mar 18, 2011 4:31 pm

I set it up so that all shows in this db are anime. All existing eps get recognized as the episode number, not absolute, though some i'm not even sure are the episode number as they are in weird places, like "Season.05\Bleach.103.Ishida,.Exceeding.the.Limits.to.Attack!.SD.TV.avi" is listed as Absolute 309 and S15E44... I've re-scanned files, done full updates, re added the show etc...

Ok, So I decided to take all the files out, rescan the show, and add them in a few at a time and rescan...and it works fine! (except the first few named 001 002 etc. they get chucked to specials until specials is full, then it continues from where they should be in season 1). If i chuck them all back in and rescan it puts them in weird spots again...manually post-processing they are recognized correctly...

Edit: Except for double episodes like 073-074. That is only recognized as the first ep and the second is ignored.

Yeah, it found it no problem and post processing works great :) Although it did find some weird avi version and not the mkv i was expecting for Fairy Tail from the fanzub provider...so i just deleted it and manually processed the right one.
psikoh
 
Posts: 10
Joined: Wed Oct 27, 2010 11:44 pm

Re: new Anime branch 2011, bugs and errors

Postby Gumbyohson » Sun Mar 20, 2011 8:06 pm

Having an issue with some shows like one piece
Logs here: http://pastebin.com/NLmZC8LF

thanks,

Gumby
Gumbyohson
 
Posts: 38
Joined: Sun Mar 20, 2011 8:04 pm

Re: new Anime branch 2011, bugs and errors

Postby lad1337 » Mon Mar 21, 2011 3:43 am

Gumbyohson wrote:Having an issue with some shows like one piece
Logs here: http://pastebin.com/NLmZC8LF


what kind of issues ? and what you posted only contains the normal log
eiher you choose debug in the dropbox on the log page or you look into the log file whch is located in the "Logs" folder in the sickbeard installfolder

i will look into the error that is visible though

Ok, So I decided to take all the files out, rescan the show, and add them in a few at a time and rescan...and it works fine! (except the first few named 001 002 etc. they get chucked to specials until specials is full, then it continues from where they should be in season 1). If i chuck them all back in and rescan it puts them in weird spots again...manually post-processing they are recognized correctly...

Edit: Except for double episodes like 073-074. That is only recognized as the first ep and the second is ignored.


ok i will look into "fals special recognising"
yes double episodes buggy
my anime branch: http://goo.gl/osNsn
support: http://goo.gl/4YUQF
issues: http://goo.gl/vdmse
##########
unofficial builds(win/osx)[normal/anime(/develp)]: http://sickbeard.lad1337.de/
##########
ImageImage
User avatar
lad1337
 
Posts: 413
Joined: Mon Mar 07, 2011 6:58 pm

Next

Return to Anime (lad1337)

Who is online

Users browsing this forum: No registered users and 0 guests