Tag: Web standards

MPEG has moved forward with a royalty-free standard activity, approving a “Call for Evidence”, the typical first step in the MPEG standardization process.

The MPEG Call for Evidence is referenced in the public Resolutions of the just-completed 93rd MPEG meeting, which also hint at an upcoming Call For Proposals.

The Call for Evidence follows the April call for active participation in a royalty-free standardization activity to verify the ISO-required minimum of 5 National Bodies willing to actively participate.

No doubt of interest in response to the Call for Evidence will be performance tests on royalty free codecs and coding techniques (perhaps along the lines of the annual MSU h.264 codec comparison, which in June released test results on Google’s VP8 codec) and background on patent and prior art searches.

The documents use the new MPEG-speak for royalty-free licensing of “Option-1 Licensing”, named for the first check box on the ISO/IEC/ITU Common Patent Policy Patent Statement and Licensing Declaration, which allows patent holders to affirm that “[t]he Patent Holder is prepared to grant a free of charge license to an unrestricted number of applicants on a worldwide, non-discriminatory basis and under other reasonable terms and conditions to make, use, and sell implementations of the above document.”

14.6 Option 1 Licensing Video Coding

14.6.1 The Requirements subgroup recommends approval of the following documents:

No. Title TBP Available
Exploration – Option 1 Licensing Video Coding ISO-group.jpg
11533 Call for Evidence on Option-1 Video Coding Technology N 10/07/30
11534 Draft Context, Objectives and Applications for Option-1 video coding for Internet applications N 10/07/30
11535 Draft Requirements for Option-1 Video coding for Internet applications N 10/07/30
11536 Draft Call for Proposals for Option-1 Video Coding for Internet applications N 10/07/30

The Requirements group requests National Bodies and experts to provide contributions on the draft Option 1 Licensing Video Coding documents

As readers of this blog know, I am a long-time proponent of royalty-free standardization as the best option for open Web media, preferable to informal, vendor-run open-sourcing of undocumented or unreviewed Intellectual Property Rights.

MPEG, an ISO working group (WG 11 of ISO/IEC JTC 1 / SC 29, to be precise), has been looking into royalty-free standardization and has issued a resolution soliciting interest in active participation by the relevant voting units (“National Bodies”).  Here is my manifesto on why a new dual-track standards activity in ISO could succeed where the 2001 h.264 royalty-free baseline failed.

So I forwarded the resolution to Steve Jobs (Apple has been a long-standing member of the MPEG committee), soliciting Apple’s support.

His response — “The problem is that it will have lower quality video…” — is in my view an accurate and reasonable conclusion and one shared by others, including the head of MPEG, who has said “I believe MPEG should enlarge its portfolio of standards by offering some that are expected to be royalty free and typically less performing and with less functionality next to those that are state of the art, more performing and with more functionality”.

Judge for yourself (no, no response to my second email):

——– Original Message ——–

Subject: Re: Please help develop a royalty-free ISO video standard
Date: Tue, 01 Jun 2010 11:21:28 -0700
From: Rob Glidden <rob.glidden@xxx.xx>
To: Steve Jobs <sjobs@apple.com>

Steve:

Same quality at ~20% more bandwidth looks patent-safe today, so not a direct replacement for h.264.

Rather, a viable HTML5 solution, because World Wide Web Consortium, vendors, and community require codec to be royalty free AND standardized (not just open sourced).

Would Apple support ISO starting standardization process for HTML5-type uses?

Rob

On 6/1/2010 10:03 AM, Steve Jobs wrote:

The problem is that it will have lower quality video…

On Jun 1, 2010, at 9:33 AM, Rob Glidden wrote:
Steve:

I am writing to encourage Apple to actively participate in developing an ISO-approved royalty-free video coding standard.

The MPEG group has issued a resolution seeking active participation in developing a Type-1 (royalty-free) video coding standard:

“Given that there is a desire for using royalty free video coding technologies for some applications such as video distribution over the Internet, MPEG wishes to enquire of National Bodies about their willingness to commit to active participation (as defined by Section 6.2.1.4 of the JTC1 directives) in developing a Type-1 video coding standard. MPEG would appreciate if NBs provide the names of individual organisations that will commit resources”

Type-1 (royalty-free) licensing has been considered at recent MPEG meetings, and multiple National Bodies have expressed their support.

ISO procedure requires active participation by individual organizations to move the activity through the ISO standards process.

Please contact your ISO / SC 29 National Body and express your support for this important standards initiative.

Kind regards

Rob Glidden

References

[1] Resolutions, the 92nd SC 29/WG 11 Meeting, 2010-04-19/23, Dresden, Germany, SC 29/WG 11 N 11241, http://www.itscj.ipsj.or.jp/sc29/open/29view/29n11185c.htm:

“Given that there is a desire for using royalty free video coding technologies for some applications such as video distribution over the Internet, MPEG wishes to enquire of National Bodies about their willingness to commit to active participation (as defined by Section 6.2.1.4 of the JTC1 directives) in developing a Type-1 video coding standard. MPEG would appreciate if NBs provide the names of individual organisations that will commit resources. MPEG will use the information gathered from the NB responses, particularly including the number of countries willing to actively participate, in order to decide at the Geneva meeting whether to request approval of a new Work Item Proposal. MPEG does not intend to reopen the issue, unless strong support of at least five national bodies is presented in the future.”

[2] ISO/IEC JTC 1 Directives, 5th Edition, Version 3.0 ISO/IEC JTC 1 N8557, http://www.itscj.ipsj.or.jp/sc29/directives.pdf:

“9.3.1.1 Votes on NPs at the SC Level

… For the ballot to be successful at the SC level, the NP shall be supported by a majority of all P-members of the SC with at least five P-members committed to active participation.

6.2.1.4  Active participation for NPs includes involvement by NBs in more than one of the following:

– Attendance at meetings (see also 7.11);
– Contributing to the development of the WD;
– Performing substantial review on a CD and subsequent stages;
– Submitting detailed comment with ballots.”

[3] Meeting Report, the 91st SC 29/WG 11 Meeting, 2010-01-18/22, Kyoto, Japan, SC 29/WG 11 N 11077, http://www.itscj.ipsj.or.jp/sc29/open/29view/29n11151c.htm:

“Royalty-free Codecs

In order to help with the discussion on royalty-free codecs, several National Bodies provided input as requested in N11066 Call for Comments on Possible Future activities on “Royalty-free” Standardization by MPEG. MPEG thanks with N11222 Responses to NB position statements on N1066. No clear conclusions could be drawn from the diverse responses. Furthermore, neither MPEG nor ISO can guarantee that a standard developed with the goal of being RAND or royalty-free will actually be RAND or royalty-free since the analysis of patents is outside of the scope and competence of ISO and MPEG.

MPEG issued document N11221 Possible future actions on standardization with Type 1 licensing where the legal issues are summarized and discussed. Type 1 licensing refers to option 1 of the joint patent declaration form, where an intellectual property holder can indicate that he will not charge for his IP. Laymen refer to this type of licensing as royalty-free.

However, MPEG believes that 20 years after its publication some technology will become royalty-free. Since parts of MPEG-1 and MPEG-2 were published in 2013 and 2014, candidates are a MPEG-2 Part 2 baseline profile carved out of MPEG-2 Part 2, MPEG-1 Part 3 Layer 2 baseline profile carved out of the MPEG-1 part 3 Layer 2, a MPEG-1 Part 3 Layer 3 baseline profile carved out of the MPEG-1 part 3 Layer 3, and a MPEG-2 Part 1 baseline profile carved out of the MPEG-2 part 1. These candidates would be compatible with existing equipment. Alternatively, MPEG may define a new set of standards which are believed to be RF provided such standards provide sufficient differentiation to be successful in the market place.“

[4] Meeting Report, the 90th SC 29/WG 11 Meeting, 2009-10-26/30, Xian, China, SC 29/WG 11 N 10876, http://www.itscj.ipsj.or.jp/sc29/open/29view/29n10944c.htm:

“Royalty-free Codecs

The Chinese National Body encouraged MPEG to discuss the option of royalty-free codecs developed within MPEG (N11065 Responses to CNNB position statement on more friendly IPR policy). Especially small companies perceive licensing as cumbersome. Some royalty free standards have become successful in the market place.

MPEG might consider royalty-free codecs only as a supplement to its current standards development process. The preliminary results of the discussion are summarized in N11067 Summary of Issues and question from the 90th MPEG Meeting in connection with CNNB input document (M16903). In order to help with this discussion, MPEG requests National Bodies to provide input according to N11066 Call for Comments on Possible Future activities on “Royalty-free” Standardization by MPEG.”

Last night Google appears to have ended its silence about its willingness to standardize VP8 and WebM.

Cnet has updated a news article, “Mozilla trying to build VP8 into HTML5 video“, with Google’s response:

“We’re excited by the community’s response to the WebM project, and we support efforts to standardize the technology,” Google said in a statement.

Updated 10:28 p.m. PDT with Google comment.

Perhaps not the most ringing endorsement of standardization, but with the W3C’s Philippe Le Hegaret pointing out in the same article that “[t]o be seriously considered by the W3C HTML Working Group, the specification would need to go through a standards group”, it must have been increasingly difficult to remain silent (or hope to arm-twist Android partners into shouldering the patent risk).

Le Hegaret’s full statement points to potential responsible next steps on the standardization path:

“WebM/VP8 has the potential of providing a solution for the baseline video format of HTML5. To be seriously considered by the W3C HTML Working Group, the specification would need to go through a standards group and be developed under RF [royalty-free] licensing participation terms,” Philippe Le Hegaret, leader of Web video work at the W3C, said in a statement. “W3C remains interested in having a video format for HTML5 that is compatible with the W3C Royalty-Free Patent Policy.”

As I have argued, standardization in a royalty free process is the right path for open video.

UPDATE (Dept. of Beware of Non-Ringing Endorsements)

The Register’s Cade Metz followed up with Mozilla to clarify their advocacy of including VP8 in HTML5:

Though Cnet says that Mozilla is working to incorporate VP8 into HTML5, the organization tells us that John Lilly was “discussing the ideal scenario for VP8, not what Mozilla is currently doing.”

The FCC Video Device Innovation Notice [1] asks one of the most fundamentally central questions to the prospect of not only a viable Broadband Plan for America, but also to the very future of the Open Internet that has revolutionized communications systems of all humanity:

“How could the Commission develop a standard that would achieve a retail market for devices that can attach to all MVPD [Multichannel Video Programming Distributor] networks and access Internet-based video sources?”

There can be little doubt that video is a central broadband driver, but simply put, today there is no standard for “Internet-based video”.  Just ask the World Wide Web Consortium, who has struggled for years to no success to find an acceptable video standard to incorporate into HTML5, the first major update to the core Web standard in a decade [2].

Of course, there is a lot of video on the Internet, but it is controlled by a hodge-podge of proprietary and so-called “semi-open” plug-ins that do not meet even the loosest definition of “standard” and certainly nothing that comes near meeting the requirements, processes, and practices of the standardizing bodies of the Web and Internet.

So developing a standard that could attach to both MVPD and Internet video would require in the first place developing a standard for Internet video, on terms acceptable to the Open Internet.  The FCC has much to contribute on this score, as do broadcasters in the burgeoning EBU-led “hybrid broadcast-broadband” initiative, which has already developed clear and measurable requirements specifically for hybrid, multi-network video standards [3].

But the non-solution to this problem is as clear as it is unacceptable.  Forcing the Open Internet to adopt the closed, “walled-garden” model and captured, controlled specifications of status-quo gridlock that are dogging digital TV, digital cable, and IPTV, or concede to proprietary control, would certainly damage the Open Internet and perpetuate the dysfunctional tendencies of “standards as trade association lobbying” that underpin this FCC notice.

The right way forward is equally clear.  Standardize, in appropriate organizations and with appropriate oversight, in the Open Internet model of uncaptured, royalty-free process, the needed elements: codecs, transport stream, conditional access, and UI middleware.

The good news is that media standards gridlock has been a global challenge addressed by regulators in retail-scale national standards, and initiatives already underway on all of these elements point to best practices, way forward to success, and pitfalls to avoid [4].  Gridlock, capture, patent overcharging, and proprietary control – key underlying contributors to the absence of the robust retail, unaffiliated device markets as contemplated by Section 629 and this notice — are not the only inevitable outcome, they can be addressed [5].

The Commission should evaluate these activities and incorporate appropriate lessons into a proactive video standardization element of the broadband plan for America, one that envisions video standards to embrace, empower, and leverage the best of the Open Internet, not one that protects walled gardens through silos of pseudo-standards and control points.

References

Notes are available in the FCC comment filing available here.

Gridlock, capture, patent overcharging, and proprietary control – key underlying contributors to the absence of the robust retail, unaffiliated device markets as contemplated by Section 629 and this notice — are not the only inevitable outcome, they can be addressed

After a lively debate, the IETF appears to be moving forward with a royalty-free audio codec standardization activity.  Here’s to its successful launch and positive outcome.

I’ve put a brief summary at the mpegrf.com site, and there is a good summary here.

The group’s email discussion alias is here — and my view, expressed there (echoing this), is pretty straightforward:

“[codec] Royalty Free codec standards — don’t settle for less”

Here is my view, perhaps you share it, perhaps you don’t.

What the world needs now is royalty-free, standardized codecs. This is critical to the future of the Web, and the progress the Internet has brought to the world, and will bring to the world.

Video, audio, transport, the whole thing. Evaluated, vetted for patents. Under an appropriate, responsible and complete royalty free process. No less.

IETF, ITU, and ISO/MPEG should all get going on this important activity — after all why shouldn’t all of these organizations include this as core to their mission.

I have, and no doubt you have too, seen countless explanations why this should not, could not, will not, rather not, might not, or can not happen. Some well meaning and sincere, some from vested interests.

There are too many “powerful” interests against it. “Important” commercial interests are ambivalent. It is too hard “legally” or “politically” or “technically”. It is just too confusing to think through. There is no longer a critical mass that cares enough about keeping the future of the Open Internet open and royalty free. The well meaning are ignorant, or naive. Etc.

Don’t settle. Take the issue of royalty free, standardized codecs all the way to the top of these organizations. Do what it takes. If it requires new organizations, start them. It it requires revised processes, revise them. This is the spirit that built the Web and the Internet, this is the spirit that is its lifeblood, and this is the spirit that needs to be at the heart of its future.

Don’t settle. Don’t let those who have tried hard already, or have only half-heartedly tried, justify the status quo or their half-heartedness. Encourage them to focus on how to take the next steps.

Don’t let convenient “interpretations” of standards processes be an excuse for never starting, never finishing, or never setting up processes that will work. Need more legal background? Find it. More technical information? Get it.

Don’t settle. The world has plenty of patent-encumbered media standards, plenty of proprietary solutions, and plenty of standards in other domains that have figured out how to deliver royalty free.

But the world does not have enough royalty-free codec standards, so this is the task that needs to be addressed.

Rob

Here is my view, perhaps you share it, perhaps you don't.

What the world needs now is royalty-free, standardized codecs. This is critical to the future of the Web, and the progress the Internet has brought to the world, and will bring to the world. Video, audio, transport, the whole thing. Evaluated, vetted for patents. Under an appropriate, responsible and complete royalty free process. No less. IETF, ITU, and ISO/MPEG should all get going on this important activity -- after all why shouldn't all of these organizations include this as core to their mission. I have, and no doubt you have too, seen countless explanations why this should not, could not, will not, rather not, might not, or can not happen. Some well meaning and sincere, some from vested interests. There are too many "powerful" interests against it. "Important" commercial interests are ambivalent. It is too hard "legally" or "politically" or "technically". It is just too confusing to think through. There is no longer a critical mass that cares enough about keeping the future of the Open Internet open and royalty free. The well meaning are ignorant, or naive. Etc. Don't settle. Take the issue of royalty free, standardized codecs all the way to the top of these organizations. Do what it takes. If it requires new organizations, start them. It it requires revised processes, revise them. This is the spirit that built the Web and the Internet, this is the spirit that is its lifeblood, and this is the spirit that needs to be at the heart of its future. Don't settle. Don't let those who have tried hard already, or have only half-heartedly tried, justify the status quo or their half-heartedness. Encourage them to focus on how to take the next steps. Don't let convenient "interpretations" of standards processes be an excuse for never starting, never finishing, or never setting up processes that will work. Need more legal background? Find it. More technical information? Get it. Don't settle. The world has plenty of patent-encumbered media standards, plenty of proprietary solutions, and plenty of standards in other domains that have figured out how to deliver royalty free. But the world does not have enough royalty-free codec standards, so this is the task that needs to be addressed. 

Rob

In late 2001, to much industry enthusiasm, H.264 and MPEG-4 AVC were launched as the world’s unifying codec family in a joint project between ITU and ISO/MPEG with the undertaking that the “JVT [Joint Video Team] will define a “baseline” profile. That profile should be royalty-free for all implementations.”

The failure to deliver on this royalty-free baseline is more than a lively standards history tale.

Years of exhausting disputes and doubts have recently resolved with court rulings soundly vindicating the original royalty-free process and vision.

And now, more than ever, the Web and broadband revolution need these groups to deliver on this 2001 royalty-free undertaking.  And in the coming months, ITU and ISO are poised to begin work on a next generation of codec and transport stream standards.

I have summarized a pro royalty-free viewpoint on how ITU and ISO/MPEG can and should go forward and complete this royalty free undertaking here.

Sun’s OMS Video codec work was mentioned in Matt Raible’s notes from the “The State of the Web 2009” session at this week’s Web Directions North conference:

“Very specifically, there’s no royalty-free codec for video. This is nothing that standards bodies can solve. The most promising is that Sun Microsystems is developing an open codec and spending money to make sure they’re not infringing on patents.”

omsvideo

Also, “open video codec” topped the panelists’ biggest-thing lists:

“After each panelist talked, John asked them questions about what’s the biggest thing they’d like to see implemented by everyone (open video codec, geo location api were the winners).”

(emphasis added)

The whole write-up is worth reading here.