Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

All Source Code Should Be Open
Developer.com ^ | 27 August 2002 | Charles Connel

Posted on 08/27/2002 5:07:42 AM PDT by ShadowAce

Most software is poorly designed and built. This statement comes as no surprise to anyone in the software industry and is elucidated well by Charles Mann in his popular article "Why Software Is So Bad". I have proposed a framework for better software architectures in my article "Most Software Stinks", which served as one of the sources for Mann's piece. But even if everyone accepted my proposal for improving software design (which they don't), there is still a problem. How do we get software designers and programmers to raise the quality of their work? Because few people ever see their immediate product (the source code), what would motivate engineers to do better? The answer is that all source code should be open and included in every software release. This single policy change would have a profound impact on the quality of software systems worldwide.

When you drive across a bridge, its design is open for inspection. You can see the overall structure, the method used to anchor the cables, the thickness of the roadbed, and so forth. If you want a closer look, you can walk the bridge and see more detail. The same is true of housing construction and automobile design. You can see both the outward appearance and the inner structure of these engineering products. With a little effort and some background knowledge, it is possible to independently evaluate the design and construction of these objects. Some internal parts may require extra work to see, such as underwater bridge pilings, roof trusses, or automobile crankshafts. In principle, though, there is nothing to stop you from examining them, and experts routinely do so.

Software, on the other hand, is a crucial piece of engineering that is shrouded in secrecy. Experienced software developers cannot look into the source code of Raytheon's air traffic control system, Windows XP, or a dental X-ray machine to see how they are built. We cannot see the number and depth of comments in the code, the calling sequence of the routines, the clarity of the variable names, or the simplicity of the executable statements. This fact makes software vastly different from other important products. We cannot see whether we are buying junk or quality. The physical equivalent would be a new bridge with all structural parts encased in impenetrable black plastic, and the builders asking us to trust them that everything is okay. As a public safety measure, we never would allow this. Similarly, few people would buy a house if the contractor refused to allow a home inspection prior to the sale. Unfortunately, this is how we buy software. Software systems have a huge global importance, but their structures are hidden from independent inspection.

This secrecy is the key reason we have such lousy software. Software designers, programmers, and managers get away with bad code because no one outside their small workgroup ever sees it. Developers write code they are ashamed of because they are pretty sure no one will look at it. Managers encourage engineers to write "quick and dirty" code to meet the next project milestone, with confidence they will not be held accountable for their part in the poor result. I have personally witnessed these actions and suspect most other software professionals have as well. Commercial software is filled with bad design, horrible coding style, inefficient algorithms, and snide comments (or no comments at all).

The solution is to release all software with a copy of its source code. This is currently the practice with nearly every other engineering discipline, because their designs are open for visual inspection and physical testing. In addition, each software developer, designer, and manager should attach their name to the sections of code they work on. All code (good or bad) would be traceable to the people who created it. This sunshine policy would improve software quality for two reasons. Everyone involved in the software creation process would take more pride in their work because their names would be on the code. And any buyer who cared to could inspect the source code to make sure they were getting good quality. Of course, not every software buyer has the expertise to perform this inspection, but some do.

I can picture software executives everywhere clutching their chests in horror at this proposal. What about intellectual property rights? Wouldn't software companies engage in widespread theft of each other's hard work? No, they wouldn't, because this is already covered by copyright law.

Consider the novels of Tom Clancy. The implementation of his writing (the words on the page) and the underlying structure (thematic development, characterization, and so on) are fully open for anyone to inspect. There is nothing obvious to prevent me from stealing these items for my own novel. In practice, however, there are many barriers to my doing so. First, it is not easy to produce good writing just because I have read some. If it were so simple, everyone would write like Shakespeare or Steinbeck. Second, someone else's writing may not plug cleanly into what I am trying to accomplish in my novel. Finally, stealing Clancy's words as my own is illegal. Mr. Clancy has plenty of ways to punish me should I write a book that has the same story line or people as one of his bestsellers. The fact this system works is illustrated by the current problems of historian Doris Kearns Goodwin, whose career has been nearly wrecked by accusations of plagiarism.

Stealing software is just as difficult as stealing literature, for the same reasons. Reading Knuth does not make me as good a programmer as he. It is notoriously difficult to plug software fragments into another program, as is shown by the frustrations of the software reuse movement. And software companies have the same copyright protection for their source code as novelists do for their writing.

Note that I am not advocating open source licensing for commercial software. This is an important point. Companies and other organizations can still own their source code, just as Tom Clancy is the owner of his writing. The licenses for source code can be as restrictive or permissive as each company chooses. But the source code would be visible.

Software businesses traditionally protect their source code like family jewels. Companies claim they do this to guard their property. In fact, the real reason often is that the software is so bad it is embarrassing. If Raytheon, IBM, Microsoft, Oracle, and so forth are producing good software products (as they claim), let's see the code. Opening up commercial source code is a necessary step toward solving the widespread problem of poor software quality.

Biography

Charles Connell is president of CHC-3 Consulting, teaches software engineering to corporate and university audiences, and writes frequently on computer topics.


TOPICS: Business/Economy; Culture/Society; Technical
KEYWORDS: linux; microsoft; opensource
Navigation: use the links below to view more comments.
first 1-2021-4041-6061-80 ... 141-144 next last

1 posted on 08/27/2002 5:07:43 AM PDT by ShadowAce
[ Post Reply | Private Reply | View Replies]

To: rdb3; TechJunkYard; dheretic
Penguin Ping
2 posted on 08/27/2002 5:08:16 AM PDT by ShadowAce
[ Post Reply | Private Reply | To 1 | View Replies]

To: ShadowAce
How do we get software designers and programmers to raise the quality of their work?

How do you get furniture makers to raise the quality of their work?
By demanding it, or shopping somewhere else.
Think different.

3 posted on 08/27/2002 5:26:38 AM PDT by Izzy Dunne
[ Post Reply | Private Reply | To 1 | View Replies]

To: ShadowAce
He may have a point. But then again, he may not.

Copyright (C) 2002 - isthisnickcool

4 posted on 08/27/2002 5:28:19 AM PDT by isthisnickcool
[ Post Reply | Private Reply | To 1 | View Replies]

To: John Robinson; B Knotts; stainlessbanner; TechJunkYard; ShadowAce; Knitebane; AppyPappy; jae471; ...
The Penguin Ping.

Want on or off? Just holla!


5 posted on 08/27/2002 5:31:28 AM PDT by rdb3
[ Post Reply | Private Reply | To 1 | View Replies]

To: ShadowAce
"What about intellectual property rights? Wouldn't software companies engage in widespread theft of each other's hard work? No, they wouldn't, because this is already covered by copyright law.">

Copyright laws would prevent someone from reusing the EXACT same code, but wouldn't a few minor changes here and there constitute a whole new program? Example: a famous chef has his own recipe for grilled salmon. He will not publish the recipe because other chefs would use it and simply substitute or add one ingredient and thus have a "new" recipe.

Complicated programs are made up of many smaller bits of code. Would the copyright protect each of these smaller bits of code individually? Or could they be taken and used elsewhere?

6 posted on 08/27/2002 5:33:06 AM PDT by Apple Pan Dowdy
[ Post Reply | Private Reply | To 1 | View Replies]

To: ShadowAce
More open source bullsh!t.
7 posted on 08/27/2002 5:37:33 AM PDT by gilor
[ Post Reply | Private Reply | To 1 | View Replies]

To: ShadowAce
When I bought a car recently, I didn't have to look at the engineering design specs or tear apart the engine to decide which one to get. I test drove the cars to get my own impressions, and checked information widely available in the market on the pros and cons of each car.

Why should software be any different? I'm an application software developer by trade, but I don't have the time or inclination to go through the source code for SQL Server. It's enough that it always does exactly what I want, gives great performance, and (if properly configured and maintained) is extremely reliable. Even if I went through that source code, I could never tell as much about the software as I can from using it firsthand.

So I don't give a flip if Microsoft releases the source code to SQL Server and most of their other products. Some of them are of questionable quality, and I don't buy or use those. Others are excellent and I use and recommend them.

They respond by continuing to improve the good ones and junking or revamping the bad ones. That's the free market. I'm happy with it.

Are you advocating force of law to make software developers open up their source code? Or are you merely suggesting that they "ought" to do so? I reread the article looking to see which you are advocating and it is not obvious to me.

If the latter ("all source code ought to be open"), then I don't agree with your opinion, but I don't see anything particularly egregious about it. If the former ("vendors should be required by law to open their source code"), then you are no friend of liberty.
8 posted on 08/27/2002 5:41:39 AM PDT by Joe Bonforte
[ Post Reply | Private Reply | To 1 | View Replies]

To: Apple Pan Dowdy
I prefer to liken code to literature. Each book is copyrighted, yet is composed of many words. Each word is obviously not copyrighted--merely their organization. As a result, we have great classics, and horrible bombs--but by studying examples of each, we can possibly create better books.

By opening the source of software, we (as a society) can examine, critique, and improve it. However, the author would still retain all ownership, with all the commercial benefits that entails.

9 posted on 08/27/2002 5:42:21 AM PDT by ShadowAce
[ Post Reply | Private Reply | To 6 | View Replies]

To: ShadowAce
So, they don't want us to patent the software, and they don't want us to keep the source secret.

Who are they and what do they want?

I sense a plot to redistribute wealth here.
10 posted on 08/27/2002 5:45:04 AM PDT by Born to Conserve
[ Post Reply | Private Reply | To 1 | View Replies]

To: ShadowAce
All Source Code Should Be Open...

And we will have the Party Central Committee FORCE those who continue to resist this universal truth. If their source isn't open, let them be sure that the Gulags ARE.

11 posted on 08/27/2002 5:45:22 AM PDT by Illbay
[ Post Reply | Private Reply | To 1 | View Replies]

To: Joe Bonforte
I don't advocate law to require vendors to open their source. I'm not sure about the author's opinion, though.

I test drove the cars to get my own impressions, and checked information widely available in the market on the pros and cons of each car.

Why do you think there is information widely available? Cars are, essentially, open-source. If they were welded shut, with no access to the internals, how could you trust a test-drive or two? How would you know how well they are built? They might last for five years then just fall apart.

In that vein, you, personally, wouldn't be requireed to look through the source code for SQL Server, but you would know others have. And if no one raises a fuss over it, or if they praise it, you would know from an independant source that it was a good product.

12 posted on 08/27/2002 5:49:05 AM PDT by ShadowAce
[ Post Reply | Private Reply | To 8 | View Replies]

To: ShadowAce
When you drive across a bridge, its design is open for inspection.

Oh, bullsh*t. Now he's talking about something that I, as a bridge engineer for some years, know about.

The fact is that very little of a bridge's "health" can be readily discerned by the casual observer.

The bridge in Oklahoma that collapsed earlier this year, did so only months after an inspection by trained inspectors. If he wants to use some kind of analogy, this ain't it.

Oh, and I have no idea how my CD player works. I squint a bit, and I can see some doohickeys and thingamabobs in there, some of which appear to go round and round, but I couldn't tell you if the thing's working correctly or about to give up the ghost.

13 posted on 08/27/2002 5:49:21 AM PDT by Illbay
[ Post Reply | Private Reply | To 1 | View Replies]

To: Born to Conserve
So, they don't want us to patent the software, ...

Note that I am not advocating open source licensing for commercial software.

14 posted on 08/27/2002 5:51:12 AM PDT by ShadowAce
[ Post Reply | Private Reply | To 10 | View Replies]

To: Illbay
The fact is that very little of a bridge's "health" can be readily discerned by the casual observer.

And, as someone who knows very little of bridges, even I knew that one was weak.

15 posted on 08/27/2002 5:53:14 AM PDT by ShadowAce
[ Post Reply | Private Reply | To 13 | View Replies]

To: gilor
More open source bullsh!t.

Couldn't be that much. You responded, afterall.

16 posted on 08/27/2002 5:58:30 AM PDT by rdb3
[ Post Reply | Private Reply | To 7 | View Replies]

To: Joe Bonforte
Why should software be any different?

Cars are cars. Software is software.

The analogy doesn't hold up.

17 posted on 08/27/2002 5:59:16 AM PDT by rdb3
[ Post Reply | Private Reply | To 8 | View Replies]

To: ShadowAce
Note that I am not advocating open source licensing for commercial software.

No one on the OSS side is asking for leaving commercial software code wide open. Isn't it amazing how the detractors will misconstrue the argument anyway?

18 posted on 08/27/2002 6:01:02 AM PDT by rdb3
[ Post Reply | Private Reply | To 14 | View Replies]

To: ShadowAce
As a developer of a [large] niche product, I agree with the thrust of the linked articles. It seems to me that no matter how well-planned and written software may be, developments in most industries preclude knowing what changes and additions will be required in the future. Sure, OOP may help, but basic design of databases is just difficult to maintain in a changing world. For that reason, after kludges have been made, etc., for about 3-4 years, we attempt to rewrite the software. Of course, much of the previous work is used, but, until we can predict the future, this is, IMHO, necessary.

Of course, this expense is onerous, not only for designing and writing, but for testing and deployment. We have tried changing our philosophy more and more away from the "give the user what he wants at all costs" to "give the user a bulletproof tool that works WELL." Feature bloat is a problem (see the "office suites" whose every addition is probably useless and only adds to unreliability and user confusion), especially if a competitor says, "I can do this and Jammer cannot!"

However, I have a problem with distributing source code. The ultimate test is whether the software is adequately tested before deployment to ensure reliability and with enough error trapping (both user and program) to prevent disaster. Other than that, how can a user evaluate software? I cannot evaluate Windows source code. But, I can tell something is sucking wind when, for example, Win2K has to be reloaded when it capriciously loses the administrator and user passwords.

Constructive negative comments are welcome.

19 posted on 08/27/2002 6:03:41 AM PDT by jammer
[ Post Reply | Private Reply | To 1 | View Replies]

To: rdb3
Couldn't be that much. You responded, afterall.

Yep, it's a fair cop. You got me there.

20 posted on 08/27/2002 6:07:18 AM PDT by gilor
[ Post Reply | Private Reply | To 16 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-4041-6061-80 ... 141-144 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson