RHF image posting feedback & FAQ
On June 17, 1999, we did a test posting of an image (cartoon) to rec.humor.funny. The posting was a multipart/alternative, with plain text including a link to a Darth-Darth Binks web page and HTML that would offer both that link and the direct display of the image for the half of the net with an HTML-handling newsreader.
In addition, readers were asked to provide their opinions on the matter in a survey.
Wow! It generated a great deal of response, as well as many questions. The answers go to the very heart of the nature of USENET itself and all the controversy that surrounds it.
Opinions were decidedly mixed and widely split. In many cases there is no clear consensus of reader opinion. This document was also posted Jun 22 to rec.humor.d -- that is where you should post any comments, rather than E-mailing.
As expected, about 50% of readers saw the image immediately in their newsreader (either Outlook Express or Netscape, the 2 most most popular USENET newsreaders.) The others found their way to the link either in their newsreader or in a browser.
Around 1600 took the survey in the first 4 days (including a weekend.) The survey was of course self-selected, which limits its value.
Viewing the Image
Of those surveyed, 30% said they saw the graphic directly, 10% could immediately click-through to it, and 34% could do a quick cut and paste into their browser. (X windows users may know that you can triple click on a line in an xterm with a URL, then move the mouse to Netscape and middle-click to go to a URL found on a line by itself.)
10% of users reported they use shell accounts, 3% said they read offline (this number is no doubt skewed low). 3% had the newsreader invoke the browser immediately, and other results accounted for under 5% of users.
In other words, most people -- at least those who could easily take the survey and wanted to -- saw the image without much difficulty.
Very few reported a failure, in spite of the bugs described below.
Newsreader Stats and abilities
I asked people to name their newsreader. Kjell Irgens calculates great stats on newsreader usage (based on posting). These give us some idea of popularity of newsreaders. Many have been stunned to see MSIE/Outlook Express and Netscape account for over 50% of postings on the net at various times, though recently they are down to 45%. While one can make some debate that perhaps all the lurkers are running other readers, somehow I doubt lurkers vary by more than a moderate margin from posters.
RHF readers do vary, however. In the table below Netscape is the big winner with 22% of respondents, and Outlook Express only has 11%. TRN has a hearty 15%, and TRN prior to 4.0 doesn't even show up in the posting stats, but I have long suspected it to be a close competitor for Agent for the #3 spot netwide.
Most people have a newsreader that handles basic MIME today, and almost everybody has a newsreader that can handle MIME if they upgrade to the latest version. MIME was written into the unofficial USENET newsreader spec back 7 years ago.
Most of the other popular newsreaders -- Agent, Newswatcher, gnus and others offered clickable URLs from the plain text or browser invocation from the reader, and the rest, TIN, TRN etc. offered easy cut and paste to those who run a windowing system and, like most, have a browser open.
It's hard to say how many people read offline, as many of them would not bother with the survey. However since most groups (other than low volume rec.humor.funny) are so high volume as to be impractical for offline reading, the number of such people is dwindling.
Of those who came to the survey, I recorded their web browser, and the vast majority (72%) came with Netscape. Only 23% used IE and 2% used lynx. This does not match ordinary web surfing. USENET or RHF readers must not like Microsoft for some reason. :-)
How did they feel about images
Evenly divided, but with only a 20% feeling they did not belong in the newsgroup at all. That's very different from the sense you would get from reading the comments. Those who were against them left far more comments than those in favour.
Complex Question of Inline (direct) images
Many users were confused, but the experiment only included links to my web site, not the actual images themselves. Users of Netscape Newsreader or Outlook Express saw the image directly because the link was an <IMG> tag -- something I probably won't repeat, as detailed below.
However, I also asked about using links vs. putting the image directly in the posting. Boy is that controversial.
Putting the image directly in the posting is actually the "USENET way" of doing binaries. It takes advantage of all that is good about USENET -- fast local access to what you want to see or read. It distributes the image and thus requires no central web server (which may be slow, far away or down). It also makes the image available to those without internet connections, or those who read offline with a capable reader. That's the USENET way.
Sounds great, right? But it also means pushing the image to those who read offline whether they want it or not, and also take time and bandwidth for those reading via NNTP over a modem without giving them the option of easily aborting or making a 2nd decision to see the image. It's also slightly inefficient because MIME encodings take 33% more space vs. sucking from the web, though modems re-compress this overhead.
The porn/binaries groups have also made most readers able to handle this.
Those who want the image get the most benefit from seeing it right in the posting. Those who want to choose (other than based on the subject line or other headers) prefer a click. Those who hate the images hate inline distribution even more (you should read the notes!)
The conclusion is that for now, use of a web link is best. That does mean requiring a fast, high capacity, reliable colocated web server, which we do have. The load actually balanced out pretty well so it was well within the capacity of the server. If USENET groups got millions of readers all viewing something at once, the inline method's efficiencies would win out.
The slim majority as you can see prefer a link, but a surprising 37% would like to see inline (with a link as well -- that's easy.)
An article on issues in image formats is available.
I also asked if you liked my cartoon. I knew the cartoon was reasonably funny because I made a T-shirt of it and got great reactions at USENIX, though of course there is no pleasing everybody. Comments ranged from "made my day", "my son hasn't stopped laughing", "you make it all worthwhile" to "I wish you had picked something funny as your first experiment."
Frankly, since -5 meant "least funny thing you have ever seen" I expect some of those votes came from people just pissed off at the idea of images.
Answers to various comments
Don't post binaries. They eat up my disk space!
A surprising number of the comments were from users concerned over disk space usage, bandwidth and other issues that implied that they thought the image had been posted inline, as a MIME format binary.
It wasn't. It was stored on a web server and fetched as a link. There are many reasons why doing it inline is actually the right "USENET way" of doing a binary, there are enough people who don't like it at this time that it probably won't be done, even though rec.humor.funny, with its extremely high readership percentage on articles, is best qualified for such activity. The antipathy is just too high, so it's not likely to be done.
Binary filters will start killing rec.humor.funny
Well, since only a link was posted that's not likely. Killers that kill HTML or multiparts might filter it. However, I strongly feel that while a site can filter as it likes, most of these filters are there to stop abuse and violation of newsgroup rules, and they should never interfere with a properly approved posting from the moderator in a moderated group.
Existing ones, like bincancel, tend not to deal with postings under 100K anyway. In spite of some beliefs, binaries do not just appear in alt.binaries.
Be sure to label any images
Of course. This image was well marked. If images were to become regular, a standardized label would be developed for those wanting to killfile.
The MIME was broken
Yes, I made an error in the MIME because the automatic generators make ugly articles, and I did some things by hand and got the final delim slightly wrong. Amazingly, almost all the tools handled it anyway! (I had only tested in a few, and they worked.)
The URL for the survey in the plain text form was broken
Mea culpa. One nice you have to give the web is the ability to fix things after the fact. Within 2 hours a redirect was in for the broken URL to make it work.
Why did the two variants differ? What about spoilers
Those seeing the HTML form of the posting were likely to see the image immediately, so some text came along with it to supplement the image.
Those reading the plain text had to do something to see the image, so the text, which might spoil the image, was not included.
I apologize for not including a spoiler warning. The spoilers in this were pretty minor but I still should have done it.
Doing your survey on the WWW will bias it.
This is true. However, E-mail surveys just are not practical. I have done them. This survey got 1600 responses, and only a web form is practical if you want responses in a form you can do statistical analysis on. People just won't follow the rules for plain text forms, sadly.
As for the bias, the strong impression I have is that web access has grown extremely ubiquitous, and that while there are certainly USENET only people out there, almost everybody by now has arranged quick and convenient web access for themselves, by lynx if nothing else. So the effects of the bias will be limited.
Why not create a rec.humor.funny.images subgroup?
This was by far the most common suggestion of those who had a comment. There are a couple of answers to it.
First of all, it is not very likely at this time that the number of images that would come here would be anywhere near enough to create a subgroup. Especially if they are presented at links, skipping the few images would be such a little effort as to make it not worthwhile. There might be one or two images a month.
However, I also feel that it is entirely the wrong idea to create separate groups and hierarchies based on format rather than subject matter. It's a commonly proposed idea, but not an idea that works long term. Newsgroups are groups of people with a common interest. In the case of RHF, it's the comedy we select. One group for those who want HTML vs. one or those who want plain text vs. one for those who want the images vs... It's an idea that's simply wrong to me.
The reasons that people support are primarily these. In many images groups, the images often are the subject matter, so the groups make sense. In some cases, the images are so voluminous that it is desired for some sites (though it has always been a minority) to have an easy means of avoiding them. That's a bit of a kludge, but was felt necessary. The truth is that it makes more sense to have the feeding tools be able to filter based on size, or content, than to use the newsgroup mechanism to handle every filtering decision. However, the tools didn't do that, so people used what they had.
People are also worried, justifiably, about abuse, both by deliberate abusers and newbies. These issues don't apply to moderated groups.
And the "anything but 80 column monospace text is evil" lobby is vocal.
However, rec.humor.funny is about comedy, and sometimes comedy comes in other forms besides words. If it's an image that matches the mission of rec.humor.funny, it belongs there, not in alt.binaries.
Images are so huge! I pay by the minute! I will need to killfile!
The image in question was 28K if you made the web connection to get it. About 9 seconds on a typical modem. There have been many text items in the history of RHF that have been larger. Today's bandwidth abilities are just orders of magnitude beyond those of the past. While there are a very few people left with very slow or expensive connections, it would be an error to say that USENET can never go beyond its lowest common denominator. (However, articles should indeed be tagged or otherwise set out to help those users wherever possible.)
Most cartoons and images for jokes can fit easily in 10 to 40KB.
I was astounded at the few who said they would, if RHF contained images, need to remove it from their feed or filter it. Even if the images were inline rather than just links, their volume in RHF would still be dwarfed by the average low-volume unmoderated text newsgroup. I can only put this sort of comment down to emotional reaction, not rational fear of high disk and bandwidth costs.
USENET is for text only, outside alt.binaries
Many even prefaced by saying, "I believe in the old school." That one shocked me. In the days before the web, groups with source code and binaries, meant primarily for computer rather than human consumption, were among the most popular. For information, I went back 10 years ago to the newsgroup popularity rankings for June of 1989. Here are the top 25.
As you can see, in the "old school," groups with other than plaintext discussion were among the most popular, and were not relegated to 'alt.' They were also among the highest volume.
Why? Because USENET, as a distributed medium, was actually great for large binary files and source. You got it on your local system. You didn't need a connection to the internet or ftp, and it was faster even if you did have one.
Now some might say that this doesn't bear on the matter today, in the world of the web, but the old school was certainly not "all text" and USENET was not designed "exclusively for text" as some felt.
This will just encourage newbies to use HTML and images
While I see the validity of this concern, I feel from a philosophical standpoint that we must not fear (especially in moderated groups) using new tools just because others might abuse them. You won't get anything new if you live that way.
Multipart/alternative is bulky and bad
While it is very inefficient, it was the only format for the experiment I wanted to do (which included testing how HTML browsers function and how many people use them.) For better or worse, Multipart/alternative is the format the MIME group developed, and USENET has adopted, for format migration and handling different browsers. I don't think it is the best and in fact designed my own better solutions. The details of this can be found here.
However, since there are problems with mult/alt, in the long term I think that the best way to provide a link is with a URL on a line by its own. Many readers pop that up as a link, and almost everybody can easily cut and paste it.
I do feel, however, that it's a kludge. Guessing links out of plain text is a really bad software design. Formal specs are much better. If we can get my OOB HTML working, that's the way to do it.
The inline image scares me. I don't like the automatic nature
Well, I agree there are concerns here. Obviously in an ideal world, you want to present a clean interface, and you would want to just automatically show the image. Users with concerns would just turn off auto loading of images. However, for now people are too worried. Some said they couldn't turn it off (that's a buggy design, I feel) and some worried their boss looks at their web fetches but not their newsreading. Some said it's visually more obvious they are reading jokes at work!
So for now, this will be avoided.
Will graphics be tasteful?
RHF does carry dirty jokes. It might carry a dirty cartoon, but there will be plenty of warnings if it does, including before click-through.
This is the start of the slipperly slope of an HTML USENET
|Did not say||137||8|
A small number of other newsreaders were listed, they were not significant in count.