All posts by js
Below are all of js's postings, with the most recent are at the bottom of the page.
MikeP: All EIT title and description strings, for services on the DVB-T2 multiplexes, are Huffman coded.
I've had to modify my decoder to deal with these errant characters as follows.
Here, lastchar is the currently decoded byte and decode is the decoded string so far:
Select Case lastchar
Case &HA, &HD, &H20 To &H7E
decode = decode + Chr(lastchar)
Case &H19
decode = decode + "{'}"
Case &H13
decode = decode + "{-}"
Case Else
decode = decode + "{hex=" + Hex(lastchar) + "}"
End Select
I'm using the curly brackets to identify and locate the fixes in the output.
The output is an xmltv file.
If I try to open the uncorrected xmltv file in my xmltv viewer application, it responds with an error message giving the line number and position in the line of the error and refuses to proceed further.
| link to this comment |
BSkyB have carried out their EPG update.
The ASTRA/BSkyB Diffs file is 140kB with 2333 lines, so rather than posting here I've included it in:
output.7z (549.99KB)
ASTRA and Freesat SI tables Summary 01-05-2018
Download Page Link:
Free large file hosting. Send big files the easy way!
| link to this comment |
I thought that the duff characters appearing in the Freeview EPG were confined to the Huffman coded strings for services on the DVB-T2 multiplexes.
I've just noticed that the same duff characters are also in DVB-T EPG data.
I don't have a Freeview HD device so I asked if someone who has would report whether the suspect characters were rendered properly in the events I listed.
I'd like to thank all those who informed me whether or not that was the case.
Now I see these duffers on DVB-T, I can check myself, no longer needing your valuable assistance.
The duff apostrophe with code 0x19 appears in 349 events over the next 7 days.
Here is one such event:
Blaze, Fri 04 May 21:00 - 22:00: Flipping Bangers
Alfa Romeo: Gus and Will are after an Italian car. They can[0x19]t afford the true classics so they let they budget dictate the vehicle and settle on a 155 from the '90s.
So how did my LG telly render the [0x19] in what should read "can't"?
It completely ignored it, outputting "cant".
:
| link to this comment |
John: You could put the scan here: Imgur: The magic of the Internet
This is a scan of mine from January: Imgur: The magic of the Internet
kuRbQcx
To get the signal to noise ratios and constellation diagrams you click on the peaks in the spectrum.
Note you need to click at, or enter, the exact frequency, otherwise it won't lock.
In the case of Sutton Coldfield:
COM7 is 746 MHz
COM8 is 754 MHz
BBC B is 626.167
BBC A is 650 MHz
D3&4 is 674 MHz
SDN is 642 MHz
ARQ A is 666 MHz
ARQ B is 618.167 MHz
Sutton Coldfield (Local Mux)is 594 MHz
| link to this comment |
Freesat Diffs:
TJC Choice has been disabled on Freesat.
UTV +1 has been added to the private Freesat test region:
Comparing files List Freesat 02-05-2018 18 01.txt and List Freesat 03-05-2018 18 01.txt
************************ CHANGED ************************
SERVICE NAME TYPE EPGID SID TSID ONID FREQ.P ENC EIT PROVIDER BOUQUETS LCN
Bouquet Change, LCN Change
TJC Choice 1 11004 50320 2065 2 11082H 0 1 Freesat 111111111111 808
TJC Choice 1 11004 50320 2065 2 11082H 0 1 Freesat EEEEEEEEEEEE
************************ NEW ************************
SERVICE NAME TYPE EPGID SID TSID ONID FREQ.P ENC EIT PROVIDER BOUQUETS LCN
UTV +1 1 01041 10231 2054 2 10906V 0 1 Freesat 100E100E100E 112
| link to this comment |
I'm used to seeing odd entries in the Freesat EITpf (now and next) for tests, but not ASTRA or BSkyB.
There are five test items, 3001 to 3005, on the BBC transponder at 10773.25 H.
According to the SDT, 3001 is of type 25 - HD and 3002 to 3005 are type 1 - SD.
I haven't seen any actual streams off them so far.
I use that transponder as a source for SI data with DVBViewer set to record a "Transponder Dump" for one minute, three times daily.
ASTRA only provides EITpf. Here is the event for 3002 from the 11 am Dump:
3002, Thu 03 May 02:30 - 07:00: Early Breakfast
Why are you listening. Sleep!
eventID = 002F, RST = 4, ONID.TSID.SID = 2.7FD.BBA, 10773.25 H
I've just looked at the BSkyB EPG and there are entries for 3001 and 3004 for next week:
3001 Tue 08 May 07:00 - 09:15 : Breakfast 18/19
Breakfast News from Broadcasting House
eventID = 001B
3001 Tue 08 May 09:15 - 10:00 : Rip Off Britain: Food 17/18
As the new series investigating food stories continues, Angela Rippon get to the bottom
eventID = 001C
3001 Tue 08 May 10:00 - 11:00 : Homes Under the Hammer 22 Spr...
...18/19. Martin, Dion and Martel follow renovation projects in Cheshire, Lanarkshire an Norfolk.
eventID = 001D
3001 Tue 08 May 11:00 - 11:45 : A1: Britain's Longest Road...
...Series 2. Simon G is here again
eventID = 001E
3001 Tue 08 May 11:45 - 12:15 : SKY Series 1
episode Series 1 1525346150 short description
eventID = 0037
3001 Tue 08 May 12:15 - 13:00 : Bargain Hunt 43 Win 15/16 (NCF)
Wetherby racecourse plays host to today's Bargain Hunt.
eventID = 0020
3001 Tue 08 May 13:00 - 13:30 : SKY Series 1
episode episode 2 1525346358 short description
eventID = 0038
3001 Tue 08 May 13:30 - 13:45 : London TV News 2018/19 Lunch
London News only
eventID = 0022
3001 Tue 08 May 13:45 - 14:15 : This is Datahub
Something in the post has a strange effect on Zara
eventID = 0023
3001 Tue 08 May 14:15 - 15:00 : 800 WORDS (SEASON 2)
The arrival of George's brother Terry has caused a buzz all over Weld.
eventID = 0024
3001 Tue 08 May 15:00 - 15:45 : PF Escape to the Country 18...
...(17/18). Ginny Buckley heads to rural Lincolnshire to help an optimistic couple with 500,000
eventID = 0025
3001 Tue 08 May 15:45 - 16:30 : Flipping Profit
The team head to Kendal to find some bargains they can turn into some flipping profit.
eventID = 0026
3001 Tue 08 May 16:30 - 17:15 : Flog It! 14 (15/16)
a collection of interesting and previously unseen finds from the show's travels
eventID = 0027
3001 Tue 08 May 17:15 - 18:00 : Pointless 19 18/19
The pointless quiz show
eventID = 0028
3001 Tue 08 May 18:00 - 18:30 : SKY Series 1
episode episode 2 1525346596 short description
eventID = 0039
3001 Tue 08 May 18:30 - 19:30 : Watchdog 18/19 Spring
Matt Allwright, Steph McGovern and Nikki Fox expose more big name companies
eventID = 0012
3001 Tue 08 May 19:30 - 20:00 : Eastenders 18/19
The drama continues in the east end
eventID = 002B
3001 Tue 08 May 20:00 - 21:00 : Holby City 20 18/19
As the pressure builds from all sides, Gaskell takes a huge risk to save his trial.
eventID = 002C
3001 Tue 08 May 21:00 - 22:00 : Split, The
Hannah finds herself caught in the middle when Nathan and Christie clash on a divorce case
eventID = 002D
3001 Tue 08 May 22:00 - 22:30 : News (BBC1) 22:00 18/19
BBC News live
eventID = 002E
3001 Tue 08 May 22:30 - 22:40 : BBC London News
London news live
eventID = 002F
3001 Tue 08 May 22:40 - 22:45 : Weather (BBC1) 22:00 18/19
Weather for you
eventID = 0030
3001 Tue 08 May 22:45 - 23:40 : Back to School With Mum and Dad
Mum and dad go back to school at the Family School
eventID = 0031
3001 Tue 08 May 23:40 - 00:00 : Harry and Meghan Interview -...
...iPlayer version. personal details of how their romance began with a blind date
eventID = 0032
3001 Wed 09 May 00:00 - 00:05 : Weather for the Week Ahead...
...(late night) 18/19 BBC1. All the Weather for the Week Ahead
eventID = 0033
3001 Wed 09 May 00:05 - 06:00 : BBC News 24 18/19 (BBC1)
All the latest news from around the world
eventID = 0034
3001 Wed 09 May 06:00 - 10:00 : Breakfast 18/19
Latest breakfast news
eventID = 0035
3004 Tue 08 May 10:00 - 12:45 : Clara Amfo
The home of Radio 1's Live Lounge.
eventID = 0000
3004 Tue 08 May 12:45 - 13:00 : Richard Jolly is a Metadata Legend
The latest news from around the UK and around the world.
eventID = 0001
3004 Tue 08 May 13:00 - 16:00 : Matt sits in for Scott
Matt sits in for Scott to entertain the nation.
eventID = 0002
3004 Tue 08 May 16:00 - 17:45 : Greg James
Greg plays What's My Age Again?
eventID = 0003
3004 Tue 08 May 17:45 - 18:00 : Richard Jolly is a Metadata Legend
The latest news from around the UK and around the world.
eventID = 0004
3004 Tue 08 May 18:00 - 19:00 : Greg James
Including the 10 Minute Takeover from 6 and more musical goodness...
eventID = 0005
3004 Tue 08 May 19:00 - 21:02 : Annie Mac
Dan Smith from Bastille and Grimmy team-up to takeover Annie Mac's show!
eventID = 0006
3004 Tue 08 May 21:02 - 23:00 : The 8th with Charlie Sloth
Charlie Sloth is live and direct from the top of BBC HQ!
eventID = 0007
3004 Tue 08 May 23:00 - 01:00 : Huw Stephens
Huw delves deep into the world of new bands and alternative sounds.
eventID = 0008
3004 Wed 09 May 01:00 - 03:00 : Annie Nightingale presents...
Annie Nightingale with the biggest bass bangers.
eventID = 0009
3004 Wed 09 May 03:00 - 04:00 : Gary Oldman and Steven Speilberg
Ali Plumb asks another two stars to chat about the Movies That Made Me.
eventID = 000A
3004 Wed 09 May 04:00 - 06:33 : Early Breakfast with Adele Roberts
Staying up or getting up, Adele's here to help.
eventID = 000B
3004 Wed 09 May 06:33 - 10:00 : The Radio 1 Breakfast Show with...
...Nick Grimshaw. Hi huuun...
eventID = 000C
| link to this comment |
The bad characters in the Freeview EIT are spreading.
The latest offender is BBC Manchester:
BBC Manchester, Thu 10 May 12:00 - 15:00: Becky Want
Becky chats to George Costigan about Long Day{'}s Journey Into Night which is on at Home.
Here we see {'}, which I have inserted in place of byte 0x19 to indicate an apostrophe was intended.
As it happens, 0x2019 is the Unicode for 'RIGHT SINGLE QUOTATION MARK'
And guess what?:
Sony Crime Channel, Sat 12 May 20:00 - 21:00: Person of Interest
No Good Deed: Reese and Finch{'}s lives are put in danger when their next person of interest stumbles upon the existence of {L'}The Machine{R'}. (S1 Ep22)
Where I have inserted {L'} in place of byte 0x18 and {R'} in place of byte 0x19.
As it happens, 0x2018 is the Unicode for 'LEFT SINGLE QUOTATION MARK'
And hows about this then:
Al Jazeera Eng HD, Thu 10 May 21:00 - 22:00: Al-Nakba
Four-part series on the history of Palestine and the events of 1948 {-} a year which the Palestinians refer to as the {L'}nakba', or catastrophe.
Where I have inserted {L'} in place of byte 0x18 and {-} in place of byte 0x13 to represent a dash or minus sign.
As it happens, 0x2013 is the Unicode for 'EN DASH'
None of these bytes are valid according to the DVB spec:
Digital Video Broadcasting (DVB); Specification for Service Information (SI) in DVB systems:
http://www.etsi.org/deliv….pdf
See Annex A: Coding of text characters.
The current culprits:
There are 388 bad characters over the next 8 days; this list is just an example from each of the services involved:
Food Network, Mon 14 May 07:45 - 08:15: Bake with Anna Olson
Morning Treats: Pastry Chef Anna Olson demonstrates how to make three classic breakfast treats. These recipes are so delicious, they{'}ll make you want to jump out of bed. (S3 Ep20)
Travel Channel, Tue 15 May 06:25 - 06:45: Garage Gold
The Garage Brothers don{'}t charge for clearing clutter, but they get to keep any valuables they unearth - and maybe even turn a profit from selling them on. (S6 Ep12)
movies4men, Mon 14 May 07:00 - 08:10: The de Havilland Comet
A documentary which charts the history and development of the world{'}s first commercial jet airliner - the British-built de Havilland Comet.
Sony Crime Channel, Mon 14 May 17:00 - 18:00: Person of Interest
No Good Deed: Reese and Finch{'}s lives are put in danger when their next person of interest stumbles upon the existence of {L'}The Machine{R'}. (S1 Ep22)
True Entertainment, Wed 16 May 00:30 - 01:30: Tenko
Disease sweeps through the camp, prompting some prisoners to contemplate a daring plan. Meanwhile, Sally and Nellie{'}s blossoming friendship becomes a source of gossip. (S1 Ep7)
TBN UK, Tue 15 May 22:30 - 23:00: The Potter's Touch
Featuring the ministry of Bishop T.D. Jakes as he tackles today{'}s topics and issues by offering practical and spiritual solutions to life{'}s toughest questions.
truTV, Tue 15 May 12:00 - 13:00: The Devil You Know
The Family Man: As women are attacked on the streets of Florida, a young mother begins to have suspicions about her husband. Melissa{'}s life is turned upside down when she learns his secret. (S4 Ep7)
Sony Crime Channel +1, Sun 13 May 03:00 - 03:55: Manson's Missing Victims
Charles Manson and his followers committed nine murders, but was that all? Those involved and those who have studied Manson don{'}t think so. This documentary investigates the alleged missing victims.
YourTV, Tue 15 May 20:00 - 21:00: Castle
When the Bough Breaks: Castle{'}s agent approaches him with a career changing opportunity, but it would mean the end of his relationship with Beckett. (S2 Ep5)
TCC, Sat 12 May 03:30 - 04:00: Cajun Pawn Stars
Buy George!: A 1790's pocket watch from Founding Father George Washington is brought into the shop. And later, will one of Louisiana{'}s first swamp boats prove to be a good buy?
FreeSports, Tue 15 May 17:15 - 19:15: World Rallycross
Belgium: Coverage of the FIA World RX season held on tracks made of asphalt and gravel. Some of the world{'}s best drivers race in cars capable of 0-60mph in 1.9 seconds.
Al Jazeera Eng HD, Tue 15 May 13:00 - 14:00: Al-Nakba
Four-part series on the history of Palestine and the events of 1948 {-} a year which the Palestinians refer to as the {L'}nakba', or catastrophe.
POP, Tue 15 May 23:00 - 23:15: Talking Tom and Friends
The Famous Monster: Talking Tom faces some serious drama after acing Talking Angela{'}s commercial audition. (S1 Ep38)
Tiny Pop, Tue 15 May 17:15 - 17:30: Ranger Rob
Ranger Ready: A test run of a new ride at Big Sky Park puts Rob{'}s ranger rescue skills to the test. (S1 Ep8)
POP Max, Sun 13 May 17:02 - 17:33: Pokemon: Black & White - Rival Destinies
Clash of the Connoisseurs!: While pursuing Ash{'}s eighth Unova Gym badge, our heroes are summoned to a place where Cilan{'}s Connoisseur skills are in high demand! (S15 Ep32)
POP+1, Wed 16 May 00:00 - 00:15: Talking Tom and Friends
The Famous Monster: Talking Tom faces some serious drama after acing Talking Angela{'}s commercial audition. (S1 Ep38)
Sports Channel Network, Wed 09 May 00:00 - 06:00: Extreme Sailing Series
Extreme Sailing Series attracts some of the world{'}s top sailors, racing the hydro-foiling GC32 catamarans on short courses around the Middle East, Asia, Europe and the Americas.
ADULT Studio 66, Wed 16 May 00:00 - 03:00: Studio 66 Nights
Watch, Listen and Interact with the UK{'}s hottest models daily. (all 18+)
BBC Manchester, Thu 10 May 12:00 - 15:00: Becky Want
Becky chats to George Costigan about Long Day{'}s Journey Into Night which is on at Home.
RNIB Connect, Sat 12 May 12:00 - 13:00: TED Radio Hour
Showcasing important ideas and inspiring stories from some of the world{'}s most remarkable minds
| link to this comment |
Chris.SE: Thanks for taking the trouble to reply.
I would be grateful if you could check the events I listed to confirm the errors are present on your Freeview device.
I did check on an LG TV and the code that corresponds to an apostrophe was ignored, so that what should be "can't" became "cant".
| link to this comment |
Chris.SE: The responsibility lies with Digital UK.
"Digital UK provides day-to-day technical management of the Freeview Electronic Programme Guide (EPG)"
http://www.digitaluk.co.u….pdf
Freesat and BSkyB evidently know how to manage the EPG data they receive from service providers:
Freesat:
Sony Crime, Mon 14 May 17:00 - 18:00: Person of Interest
No Good Deed: Reese and Finch's lives are put in danger when their next person of interest stumbles upon the existence of 'The Machine'. (S1 Ep22)
BSkyB:
Sony Crime, Mon 14 May 17:00 - 18:00: Person of Interest
No Good Deed: Reese and Finch's lives are put in danger when their next person of interest stumbles upon the existence of 'The Machine'. (S1 Ep22)
Freeview:
Sony Crime Channel, Mon 14 May 17:00 - 18:00: Person of Interest
No Good Deed: Reese and Finch{'}s lives are put in danger when their next person of interest stumbles upon the existence of {L'}The Machine{R'}. (S1 Ep22)
I would expect Freeview devices to ignore the incorrect codes, rendering what should be "Finch's" as "Finchs" and "'The Machine''" as "The Machine".
| link to this comment |
Tuesday 1 May 2018 2:51AM
MikeP: The Al Jazeera HD event is on now so I've grabbed the EITpf off Freesat, ASTRA and Freeview:
Freesat_pf:
Al Jazeera Eng, Tue 01 May 2018 02:00 - Tue 01 May 2018 03:00: The Coming War On China
Journalist John Pilger, reveals what the news doesn't _ that the world's greatest military power, the U.S. may well be on the road to war with China.
ASTRA_pf:
Al Jazeera HD, Tue 01 May 02:00 - 03:00: The Coming War On China
Ep.2 Journalist John Pilger, reveals what the news doesn't - that the world's greatest military power, the U.S. may well be on the road to war with China.
North West_BBC A_pf:
Al Jazeera Eng HD, Tue 01 May 02:00 - 03:00: The Coming War On China
Journalist John Pilger, reveals what the news doesn't that the world's greatest military power, the U.S. may well be on the road to war with China.
We see an underscore character on Freesat; a dash or minus sign on ASTRA; and garbage on Freeview.