You are here

Pluto.tv

35 posts / 0 new
Last post
enaz
Offline
Donator
Joined: 10 years
Last seen: 2 years
Pluto.tv

Hey All,

Is there anyone willing to have a look at the pluto.tv scraper INI and update it.. Looks like it just not parsing the json file correctly. e.g Gets the json file fine, but doesn't seam to restrict to channel or scrap the right title etc..

e.g. below is what's returned for ONE Channel. But its completely borked..

<tv generator-info-name="WebGrab+Plus/w MDB &amp; REX Postprocess -- version V2.1.9 -- Jan van Straaten" generator-info-url="http://www.webgrabplus.com">
<channel id="Action Movies (PlutoTV)">
<display-name lang="en">Action Movies (PlutoTV)</display-name>
<url>http://www.pluto.tv</url>
</channel>
<programme start="20190816144500 +0000" stop="20190816164500 +0000" channel="Action Movies (PlutoTV)">
<title lang="en">Girls! Girls! Girls!</title>
<desc lang="en">Elvis plays a charter-boat skipper who helps tourists land the big ones. Of course, plenty of beautiful girls want to land Elvis. But there’s something Elvis likes almost as much as romance–a boat! Elvis plays a charter-boat skipper who helps tourists land the big ones. Of course, plenty of beautiful girls want to land Elvis. But there’s something Elvis likes almost as much as romance–a boat!(n)</desc>
</programme>
<programme start="20190816070000 +0000" stop="20190816203000 +0000" channel="Action Movies (PlutoTV)">
<title lang="en">Game of Assassins</title>
<title lang="en">Maximum Risk</title>
<title lang="en">Nowhere to Run</title>
<title lang="en">Lone Wolf McQuade</title>
<title lang="en">The 6th Day</title>
<title lang="en">Live</title>
<title lang="en">CBS News</title>
<title lang="en">Live Stream</title>
<title lang="en">NASA</title>
<title lang="en">La Isla</title>
<title lang="en">Listen to</title>
<title lang="en">Overbooked</title>
<title lang="en">Mustang Ranch: Labor of Love</title>
<title lang="en">Jennifer's Radio Show</title>
<title lang="en">Wild Horse Goes to Court</title>
<title lang="en">In Sanatorium</title>
<title lang="en">Celebrity Paranormal Project</title>
<title lang="en">Pearl</title>
<title lang="en">The First Warden</title>
<title lang="en">Mad Ray</title>
<title lang="en">Tanner's Ghost</title>

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours

sure, will update soon, just be patient (it's holiday period here)

enaz
Offline
Donator
Joined: 10 years
Last seen: 2 years
mat8861 wrote:

sure, will update soon, just be patient (it's holiday period here)

Mat8861 , thank you no rush, at all.. sit back and have a beer or 4.. :)

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours

Dunno how good it is as it is one day only, but later will post it and search if they have other sources

enaz
Offline
Donator
Joined: 10 years
Last seen: 2 years

WOW did you get something working already? If you want me to give it a run and verify i'm happy to do that.. One day of EPG is better than 0 days.

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours
enaz
Offline
Donator
Joined: 10 years
Last seen: 2 years
mat8861 wrote:

uploaded here (E version) https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/site...

Mat,
Thank you that seams to be working.. I'll keep running it for the next few days and let you know.. p.s any Chance to get an unencrypted copy?

enaz
Offline
Donator
Joined: 10 years
Last seen: 2 years
mat8861 wrote:

uploaded here (E version) https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/site...

Mat, the scraper you update has been working awesome.. HOWEVER it appears pluto TV has done and update.. It appears that now the channels guide is getting is source from

https://api.pluto.tv/v2/channels?start=2019-09-04T00:00:00.000Z&stop=201...

and NOT

http://cdn-api.prod.pluto.tv/v2/timelines/2014-08-01T16:00:00.000Z/2014-...

The New url list all the channels and then has Timelines as an element for each channel.

Any change to get the scrapper updated?

jamesm147
Offline
Donator
Joined: 5 years
Last seen: 4 months

Has an update been released of this scrapper? Rev.2 is not working anymore.

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

Hi, I signed up/made a donation yesterday and got the software installed without issue.

My main reason was to be able to use it for Pluto but whenever I try to run the cron process I get:

error downloading page: Error: NameResolutionFailure

Since the ini is encrypted I'm not sure which part is not working. Is there any chance of an update for this ini?

Thank you :)

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours

i will check plutotv site.ini there are changes

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

Thank you for getting back so fast!

My nslookup seems ok as well:

Non-authoritative answer:
Name: pluto.tv
Address: 99.84.194.71
Name: pluto.tv
Address: 99.84.194.116
Name: pluto.tv
Address: 99.84.194.128
Name: pluto.tv
Address: 99.84.194.55

I am running this from the linuxserver docker if that makes a difference.

EDIT:
Changed my connection a bit and I don't get the DNS error anymore. Now I get this:

Unable to update channel Food TV
Generic syntax exception:
message:
no index page data received from Food TV
unable to update channel, try again later
No guide data to restore

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours

Update siteini.pack, but be informed that is one day only !!

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

It works!! Thank you so much for taking the time to update that for us!

One day is fine for now because I'm not recording anything anyway.

Is it quite a bit more complex to add more days?

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours

the site only provide one day, unless you can see a schedule with more days logging in.

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

Got it :)

Thank you for clarifying and also for the update yesterday. It's working great now!

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

Just in case anyone is following along, it appears that they provide ~8hrs of guide data at a time and not a complete 24hr schedule.

It works but requires running the script more often to keep the guide up to date.

enaz
Offline
Donator
Joined: 10 years
Last seen: 2 years
wgp123456 wrote:

Thank you for getting back so fast!
My nslookup seems ok as well:
Non-authoritative answer:
Name: pluto.tv
Address: 99.84.194.71
Name: pluto.tv
Address: 99.84.194.116
Name: pluto.tv
Address: 99.84.194.128
Name: pluto.tv
Address: 99.84.194.55
I am running this from the linuxserver docker if that makes a difference.
EDIT:
Changed my connection a bit and I don't get the DNS error anymore. Now I get this:
Unable to update channel Food TV
Generic syntax exception:
message:
no index page data received from Food TV
unable to update channel, try again later
No guide data to restore

@wgp123456 How did you get around this as i'm facing the same thing here in AUS..

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

@enaz I updated my ini with the updated one on git.

jhr1948
Offline
Donator
Joined: 4 years
Last seen: 1 day

Hi, did Pluto TV change something up again? I'm getting 2 hours worth of guide only.

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

I can still get 6 hours at a time but I ended up using my own solution. I run it as a cron job every 6 hours and it's been solid.

I'm familiar with PHP so using that I can pull in the JSON from them and generate the proper XML/M3U files. I prefer this because I want to be able to manage this myself and the ini is encrypted...

It's really not that complicated once you look at the JSON file. You just need to figure out how to download it, go through the array of returned data, and then generate the files you need.

jhr1948
Offline
Donator
Joined: 4 years
Last seen: 1 day
wgp123456 wrote:

I can still get 6 hours at a time but I ended up using my own solution. I run it as a cron job every 6 hours and it's been solid.
I'm familiar with PHP so using that I can pull in the JSON from them and generate the proper XML/M3U files. I prefer this because I want to be able to manage this myself and the ini is encrypted...
It's really not that complicated once you look at the JSON file. You just need to figure out how to download it, go through the array of returned data, and then generate the files you need.

I would love to know how to get xml data from Pluto, but hot too familiar with PHP. I looked up, but have not figured it out. Is there a good guide somewhere?

Thanks

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours

the same as you set wg to run every 6 hours and sincerly to me is useless, you still have to wait to get data so at end of the day what you have is past shows.

wgp123456
Offline
Donator
Joined: 4 years
Last seen: 4 years

Like Mat said, you can just set wg to run every 6 hours or however often you need it to. That would be the simplest solution!

I don't think it's appropriate to go into detail about my solution on the forum. If you want more detail I would be willing to share more privately.

I still think wg is an awesome piece of software. I rolled out my own solution because I like to have fine tune control over what's happening and I didn't want to rely on someone else every time the encrypted ini needs updating. I used PHP because it's something I am familiar with. A simple google search will give you tons of info on manipulating data with PHP.

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 4 hours

you are right,are pluto tv chans really that important?
I know one like to have epg for as much as they can but at the end of the day is it something a regular user can use is the big question.
I know php can load a json file into a array no prob.
simply select the sub array with the channel u want,little more work and and write to xml as php can do this also.

jhr1948
Offline
Donator
Joined: 4 years
Last seen: 1 day
Blackbear199 wrote:

you are right,are pluto tv chans really that important?
I know one like to have epg for as much as they can but at the end of the day is it something a regular user can use is the big question.
I know php can load a json file into a array no prob.
simply select the sub array with the channel u want,little more work and and write to xml as php can do this also.

I understand.  I really don't want to run cron jobs multiple times a day, but i can't find 2 channels.
Anyone know where to find PeopleTV and Law & Crime TV?

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 4 hours

the problem with channels like these is they are web channels and no providers carry them,hence no epg with existing ini.

jhr1948
Offline
Donator
Joined: 4 years
Last seen: 1 day
Blackbear199 wrote:

the problem with channels like these is they are web channels and no providers carry them,hence no epg with existing ini.

Correct, but they are available on PlutoTV, which is why i was considering this route. I can't figure out how to only grab 6 hours anyway. When I run it, it runs as 1 day and grabs other channel's guide after the 6 hours to fill in 24 hours. I've read the manual looking for away to set only 6 hours and can't seem to find it.

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 4 hours

u don't need to figure out how to grab 6 hrs.
it has 6 hrs epg when webgrab reads site data.
so u need to grab same data every 6 hrs(run crond 00:00(midnight),06:00,12:00,18:00.
then merge this with current data.

jhr1948
Offline
Donator
Joined: 4 years
Last seen: 1 day
Blackbear199 wrote:

u don't need to figure out how to grab 6 hrs.
it has 6 hrs epg when webgrab reads site data.
so u need to grab same data every 6 hrs(run crond 00:00(midnight),06:00,12:00,18:00.
then merge this with current data.

That's not happening to me. Take a look at my xml created for "PeopleTV" using Pluto.

After about 8 hours it's adding 3 shows from the History Channel.  Some show called "Battleplan".

Attachments: 
Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 4 hours

quick look at ur xml and it needs some fixes,unidecode for 1.
least of ur worries.
why its adding show from another channel is another issue.

jhr1948
Offline
Donator
Joined: 4 years
Last seen: 1 day
Blackbear199 wrote:

quick look at ur xml and it needs some fixes,unidecode for 1.
least of ur worries.
why its adding show from another channel is another issue.

What's wrong with my xml? That's how its generated using Webgrab++.  This is still pretty new to me, so not sure what you meant about unicode.  Is there something I'm supposed to adjust in the config file?
 
As far as why there are shows from a different channel added, i wish i knew what was happening.  That's why i had asked earlier if i could do hours instead of days.
 

1bigfan
Offline
Joined: 4 years
Last seen: 4 years

Hello - there had been a few channels and all the music "audio" channels not showing data previously and today not seeing data for several more channels including "Stories by AMC"

Is anyone else seeing this as well?

mosli
Offline
Donator
Joined: 4 years
Last seen: 11 months

I did a pull request on Github for Pluto TV DACH (Germany, Austria, Switzerland).
Edit:
official github https://github.com/SilentButeo2/webgrabplus-siteinipack

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 13 hours
mosli wrote:

I did a pull request on Github for Pluto TV DACH (Germany, Austria, Switzerland).
Edit:
official github https://github.com/SilentButeo2/webgrabplus-siteinipack

That channel list is 4 years old and those channels are not working. Please do not confuse users.

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl