RFC 7760

Statement of Work for Extensions to the IETF Datatracker for Author Statistics

๐Ÿ“… published January 2016, from ietf

RFC 7760: Statement of Work for Extensions to the IETF Datatracker for Author Statistics ๐Ÿ“Šโœจ

Part 1 of 2 ๐Ÿ’…

Okay bestie, here's the title block tea โ˜•. RFC 7760 was written by R. Housley of Vigil Security, dated January 2016, with ISSN 2070-1721. It's filed as Informational, so it's not a standard, just useful info ๐Ÿงš. The title block has no Obsoletes or Updates line, so this doc isn't replacing or amending anything ๐ŸŒธ.

Abstract ๐Ÿฆ‹

Okay so the abstract is short and sweet. This is the Statement of Work (SOW) for extending the IETF Datatracker so it can show statistics about RFCs and Internet-Drafts and the people who write them ๐Ÿ“ˆ.

Status of This Memo ๐Ÿ“

Not a Standards Track spec, bestie ๐Ÿ™ˆ. It's published for informational purposes only.

This is an IETF product, so it reflects the consensus of the IETF community ๐Ÿซถ. It got public review and was approved for publication by the Internet Engineering Steering Group (IESG). Not every IESG-approved doc is a candidate for any level of Internet Standard, though. See Section 2 of RFC 5741 for the details ๐Ÿ’œ.

You can find the current status, any errata, and ways to send feedback at http://www.rfc-editor.org/info/rfc7760.

Copyright (c) 2016 IETF Trust and the persons identified as the document authors. All rights reserved ๐ŸŒˆ.

This doc is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents, which you can read at http://trustee.ietf.org/license-info as they stood on the publication date. Please actually read them, because they explain your rights and restrictions ๐ŸŽ€. If you pull Code Components out of this document, they must include the Simplified BSD License text described in Section 4.e of the Trust Legal Provisions. They come without warranty, as the Simplified BSD License describes ๐Ÿ”ฅ.

Table of Contents ๐Ÿ—บ๏ธ

1.  Introduction . . . . . . . . . . . . . . . . . . . . . . . . .  2
2.  Purpose  . . . . . . . . . . . . . . . . . . . . . . . . . . .  2
3.  Statistics . . . . . . . . . . . . . . . . . . . . . . . . . .  3
  3.1.  Documents  . . . . . . . . . . . . . . . . . . . . . . . .  3
  3.2.  Authors  . . . . . . . . . . . . . . . . . . . . . . . . .  4
  3.3.  Affiliation of Authors . . . . . . . . . . . . . . . . . .  4
  3.4.  Countries of Authors . . . . . . . . . . . . . . . . . . .  5
  3.5.  Continents of Authors  . . . . . . . . . . . . . . . . . .  5
4.  IETF Meeting Attendees . . . . . . . . . . . . . . . . . . . .  6
  4.1.  Countries of IETF Meeting Attendees  . . . . . . . . . . .  6
  4.2.  Continents of IETF Meeting Attendees . . . . . . . . . . .  6
5.  Existing Code  . . . . . . . . . . . . . . . . . . . . . . . .  6
6.  Deployment . . . . . . . . . . . . . . . . . . . . . . . . . .  7
7.  Thoughts on Future Enhancements  . . . . . . . . . . . . . . .  7
8.  Security Considerations  . . . . . . . . . . . . . . . . . . .  8
9.  Informative References   . . . . . . . . . . . . . . . . . . .  8
Author's Address . . . . . . . . . . . . . . . . . . . . . . . . .  8

1. Introduction โœจ

So a prominent member of the IETF community built a set of tools that make statistics about RFC and Internet-Draft authors ๐Ÿ™Œ. They work by analyzing the documents themselves to produce stats about both the docs and their authors. The goal here is to get similar stats built into the IETF Datatracker and make sure the software stays maintained as part of the IETF information services ๐Ÿ’œ. Some data may still have to be pulled out of the documents, but as much as possible should be kept in the IETF Datatracker database [DATATRACKER] ๐Ÿงš.

You can see the current stats on the web at http://www.arkko.com/tools/docstats.html ๐Ÿ“Š.

The code that makes these stats lives at http://www.arkko.com/tools/authorstats.html ๐Ÿ’ป.

2. Purpose ๐ŸŒธ

Author stats let the community see where the work is happening and who's doing it ๐Ÿ‘€. They show which individuals, companies, and regions are the most active contributors, and how that changes over the years ๐Ÿ“ˆ.

Some of the stats are just "nice to know" ๐Ÿค“. Others get used to point at a particular participant's contributions to the IETF, or to study trends in IETF work. For example, the IETF has been trying to grow the diversity of its participants, and these stats are one way to see whether those efforts are working ๐ŸŒˆ. The most active individuals are also potential candidates for leadership positions ๐Ÿ‘‘.

3. Statistics ๐Ÿ“ˆ

The Datatracker enhancements shall provide stats and graphs about documents, document authors, author affiliation, author country, and author continent ๐Ÿ’….

The stats should also cover trends among IETF meeting attendees, which the current tools don't track ๐Ÿซถ.

For these requirements, "recent Internet-Drafts" and "recent RFCs" mean documents published in the last five years โณ.

3.1. Documents ๐Ÿ“„

The stats shall show the number of authors per document ๐Ÿ‘ฏ. The current web page presents this as stats plus a bar chart, and you can see it at http://www.arkko.com/tools/rfcstats/authdistr.html ๐Ÿ“Š.

The stats shall also show how big the documents are ๐Ÿ“. The current web page presents this as stats plus a bar chart, and you can see it at http://www.arkko.com/tools/allstats/pagedistr.html. Since the document format is changing, some other way to measure size might make more sense, such as word count ๐Ÿค”.

On top of that, stats about the document format the authors used should be provided, which the current tools don't do ๐ŸŽ€.

The stats shall also show how the various specification techniques get used, such as ABNF, ASN.1, C code, CBOR, JSON, and XML ๐Ÿง . The current web page doesn't include all of these, and you can see it at http://www.arkko.com/tools/allstats/formatdistr.html ๐Ÿ™ˆ.

3.2. Authors ๐Ÿง‘โ€๐Ÿ’ป

The stats shall show how authors are distributed by how many documents they've written, for recent Internet-Drafts, recent RFCs, and all RFCs ๐Ÿ’–. The current web pages with similar info include stats and a bar chart. They live at http://www.arkko.com/tools/stats/authactdistr.html, http://www.arkko.com/tools/recrfcstats/authactdistr.html, and http://www.arkko.com/tools/rfcstats/authactdistr.html ๐ŸŒŸ.

The stats shall also show the relative impact of authors, measured by how many of their RFCs other RFCs cite ๐Ÿ”ฅ. The current web page is at http://www.arkko.com/tools/rfcstats/hindextop.html ๐Ÿ’œ.

3.3. Affiliation of Authors ๐Ÿข

The stats shall show the affiliations of authors for recent Internet-Drafts, recent RFCs, and all RFCs ๐Ÿ’ผ. The current web pages with similar info include stats and a bar chart. They live at http://www.arkko.com/tools/allstats/companies.html, http://www.arkko.com/tools/stats/companydistr.html, http://www.arkko.com/tools/recrfcstats/companydistr.html, and http://www.arkko.com/tools/rfcstats/companydistr.html โœจ.

The stats shall also show how the affiliations of RFC authors have changed over the years ๐Ÿ•ฐ๏ธ. The current web page is at http://www.arkko.com/tools/rfcstats/companydistrhist.html ๐Ÿ“œ.

3.4. Countries of Authors ๐ŸŒ

The stats shall show the countries of authors for recent Internet-Drafts, recent RFCs, and all RFCs ๐Ÿ—บ๏ธ. Country stats have been useful, and so has showing the European Union (EU) as a single "country" so it can be compared with other big countries ๐Ÿ‡ช๐Ÿ‡บ. The current web pages with similar info include stats and a bar chart. They live at:

The stats shall also show how the number of Internet-Draft and RFC authors per country has changed over time ๐Ÿ“‰. The current web page is at http://www.arkko.com/tools/rfcstats/countrydistrhist.html ๐ŸŒธ.

3.5. Continents of Authors ๐ŸŒ

The stats shall show the continents of authors for recent Internet-Drafts, recent RFCs, and all RFCs ๐ŸŒŽ. The current web pages with similar info include stats and a bar chart. They live at http://www.arkko.com/tools/stats/d-contdistr.html, http://www.arkko.com/tools/recrfcstats/d-contdistr.html, and http://www.arkko.com/tools/rfcstats/d-contdistr.html ๐Ÿ’ซ.

The stats shall also show how the number of Internet-Draft and RFC authors per continent has changed over time ๐Ÿฆ‹. The current pages can be seen at http://www.arkko.com/tools/rfcstats/d-contdistrhist.html ๐Ÿงš.

5. Existing Code ๐Ÿ’พ

okay so the new code is gonna be driven by the Datatracker database as much as possible, which means the existing code might not be super useful ๐Ÿฅฒ it was always meant to be a temporary fix and it needs a full rewrite. BUT a set of heuristics the code uses might still be useful โœจ those live in a separate rule database and only get used as a last resort when there's otherwise too little info. the heuristics cover author aliases, some recognized authors and some recognized affiliations, domain name data for figuring out location and affiliation, and mappings for some of the ways people write their country in a postal address ๐Ÿ—บ๏ธ

authors are not consistent about how their names show up across documents ๐Ÿ™ˆ like one doc has their given name and another has a nickname. the Datatracker database has a way to capture aliases, but not all of the aliases from the documents have been added yet. it's giving messy but fixable ๐Ÿ’…

the current Datatracker database doesn't have tables for heuristics other than author aliases, so the tables the current tool uses are missing. appropriate tables to hold the additional heuristics from the current rule database should be added to the Datatracker database, in a manner agreed by the group of people that maintain the Datatracker source code ๐Ÿซถ

a workable web interface, possibly using Django Admin, to update the new heuristics tables shall be provided. so yes, somebody's gotta make it easy to edit these tables ๐Ÿงš

the current code lives at http://www.arkko.com/tools/authorstats.html. it's openly available, but comes without any warranty, so use it with eyes open ๐Ÿ‘€

the software is split into two parts: the code itself, and the heuristics database, which is kept separate. the two main components of the code are authorstats, which produces the statistics and generates the statistics web pages, and getauthors, which performs document analysis ๐Ÿ’–


6. Deployment ๐Ÿš€

the current tools analyze the documents themselves to produce statistics. some of the data needed for those stats isn't in the Datatracker database yet ๐Ÿ˜ญ this development effort will include adding the ability to capture that data in the Datatracker database and populating it for all RFCs and Internet-Drafts posted over the last five years. it may be cost-effective to leverage the existing code to extract the info and then verify it one time ๐Ÿง 

the URLs for the current tools are all over the Web, so once a suitable replacement tool is available, the author of the original tools has promised to provide a suitable form of redirection. a glow-up with a redirect, iconic ๐Ÿฆ‹


7. Thoughts on Future Enhancements ๐Ÿ”ฎ

with the planned change in document format, some of the info we currently get through heuristics might be extracted more directly from the XML file โœจ once this format is being used by a significant number of authors, a future effort might move away from heuristics and toward extraction from the XML file. to support that, it would be desirable for the new XML schema to make the author's continent of residence available, even if it isn't used in formatting the human-readable document ๐ŸŒ

right now the Datatracker has info about document authors, but not other contributors. if info about contributors is added in the future, the statistics can be expanded to cover contributors as well as authors ๐ŸŒธ


8. Security Considerations ๐Ÿ”

โš ๏ธ okay bestie, this part is serious, so read it carefully. this document contains the SOW for enhancements to the IETF Datatracker to provide author statistics. these enhancements do not affect the security of the Internet. the enhancements provide statistics about documents that are available to the public without prior authentication, and the statistics will also be available to the public without prior authentication. so nothing here is locked behind a login, and that's the whole vibe ๐Ÿ™ˆ๐Ÿ’€

9. Informative References ๐Ÿ“š

[DATATRACKER] is the reference we need here: [DATATRACKER] Internet Engineering Task Force, "IETF Datatracker", <https://datatracker.ietf.org/>. ๐ŸŽ€


Author's Address ๐Ÿ’Œ

Russ Housley
Vigil Security, LLC
918 Spring Knoll Drive
Herndon, VA  20170
United States

Email: housley@vigilsec.com
๐Ÿ“ฆ where this page comes from