Welcome!

Python Authors: Matt Davis, AppDynamics Blog, Pat Romanski, Donald Meyer, Liz McMillan

Blog Feed Post

[berkman] Dries Buytaert: Drupal and sustaining collaborative efforts

Dries Buytaert [twitter:Dries] , the founder of Drupal and co-founder of Acquia, is giving a Berkman lunch talk about building and sustaining online collaborations.

NOTE: Live-blogging. Getting things wrong. Missing points. Omitting key information. Introducing artificial choppiness. Over-emphasizing small matters. Paraphrasing badly. Not running a spellpchecker. Mangling other people’s ideas and words. You are warned, people.

Drupal is an open source content manager, Dries says. In the past twelve years, Drupal has “grown significantly”: 71 of the top 100 universities use it, 120 nations use it, the White House uses it, 2 of of the 3 top music companies use it, the King of Belgium uses it. [Dries is Belgian :) ] The NY Stock Exchange is converting from a proprietary Java solution to Drupal. Five of the 6 top media companies use it. One out of 50 wesbites run on Drupal. Drupal has 10,000+ modules, 300,000 downloads a month, 1.5M unique visitors a month at drupal. org. And it’s free as in beer.

Today he’s going to talk about: history, open source, community, the evolution of software, and how to grow and sustain it.

History

Dries began writing Drupal in his dorm room, more or less by accident. He wrote a message board for the Linux project, in part to learn PHP and MySQL. About a year later he released Drupal 1.0 as open source, as “a full-featured content management/discussion engine…suitable to setup a news-driven comunity or portal site similar to kuro5hin.org and slashdot.org” (as it said in the original annoucement). “It took me about 30 seconds to come up with the name Drupal, a terrible name.”

Three years later (v.4.1) he says it still looked “pretty crappy.” Two years laer,in 2005, 30 develoeprs showed up for the first DrupalCon, in Antwerp. There are now several year. By 2011, it was looking quite good, and 3,200+ developers showed up at DrupalCon. There are now weekly meetings around the world.

There were growing pains, he says. He tells us about The Big Server Meltdown. In 2004, the servers failed. Dries put up a blank page with a PayPal button to raise $3,000 for a server. Within 24 hours, they’d raised $10,000. One of the CTOs of Sun shipped him a $8,000 machine. Then Open Source Labs in Portland OR offered to house the servers. “That’s just one anecdote. In the history of Drupal, it feels like we’ve had hundreds of these.” (There are currently 8 staff members. They organize conferences and keep the servers up. )

But, Dries says, this shows a weakness in open source: you suddenly have to raise $3,000 and may not be able to do so. That’s a reason he started Acquia, which provides support for Drupal.

Open Source

Drupal is open source: It’s gratis, anyone can look at the source code, they can modify the code, and they can share it. The fact that it’s free sometimes let’s them win bids, but open source “is not just a software license. It’s a collaboration model.” “Open source leads to community.” And “ultimately, that leads to innovation.”

Dries shows photos of the community’s embrace of Drupal (and its logo). “Drupal is successful today because of the community.”

Q: How do we know there will be enthusiastic support a few years down the road? How do we know it won’t have a Y2K problem?

A: There isn’t an easy answer. Things can go wrong. We try to keep it relevant. We have a good track record of innovation and keeping the right trends. And a lot of it comes down to keeping the community engaged. We have a large ecosystem. They volunteer their time, but the are all making money; they have an economic interest in keeping Drupal relevant.

Community

“Drupal doesn’t win just because it’s cheaper. It wins because it’s better.” It is technically superior because it has thousands of developers.

Evolution of software

Dries points to a common pattern: From innovation to bespoke systems to products to commoditization. In each step, the reach becomes wider. Proprietary software tends to stop at the products stage; it’s hard to become a commodity because proprietary software is too expensive. This is an important opportunity for open source.

Growing large projects

Is Drupal’s growth sustainable? That’s a reason Dries founded the Drupal Association, a non-profit, in 2006. It helps maintain drupal.org, organizes events, etc. But Drupal also needs companies like Acquia to get it into new areas. It needs support. It needs people who can talk to CIOs in large companies.

Open source Joomla recently hired some developers to work on their core software, which has led some of the contributors to back off. Why should they contribute their time if Joomla is paying some folks? [Joomla's experience illustrates the truth of the Wealth of Networks: Putting money into collab can harm the collab.] Drupal is not going to do that. (Acquia develops some non-open source Drupal tools.)

IBM and RedHat are the top contributors to Linux. What companies might make that sort of strategic investment in Drupal? Instead of one or two, how about hundreds? So Dries created “Large Scale Drupal,” a membership org to jointly fund developments. It’s new. They contribute money and get a say in where it’s spent. The members are users of Drupal. E.g., Warner Music. Module developers can get funded from LSD. Two people run it, paid by Acquia. There has not been any pushback from the dev community because there’s no special backdoor by which these projects get added to the Drupal core. In fact, the money is then spent to fund developers. Dries sets the technical roadmap by listening to the community; neither the Drupal Association or LSD influences that.

Of these collaborative projects often start as small, volunteer-driven projects. But then they become institutionalized when they grow. Trade routes are like that: they were originally worn into the ground, but then become driven by commercial organizations, and finally are governed by the government. Many others exhibit the same pattern. Can open source avoid it?

Q&A

If you’re thinking of starting an open source commercial company, you could do dual licensing, but Drupal has not made that choice.

Q: How much does Drupal contribute to the PHP community?
A: A little. There are tribes: some are active in the PHP tribe, others in the Drupal tribe. It’s unfortunate that there isn’t more interaction. Dries says he’d love to grow Acquia enough so that it can put a couple of people on PHP, because if PHP isn’t successful, neither is Drupal.

Q: Governance?
A: We don’t have a lot of decision-making structure. I’ve always been opposed to formal voting. We work through discussion. We debate what should be in the core. Whoever wants to participates in the debate. Ultimately we’re structured like Linux: there are two people who are committing changes to a core version of Drupal. For every major version I pick someone to work alongside me. When we release the version, he or she becomes the maintainer of it. I move on to the next version and select someone to be my co-maintainer. The 15,000 modules are maintained by the community.

Q: Do your biggest contributors agree to programming standards?
A: We are strict about our coding and documentation standards. I make the final decisions about whether to accept a patch. Patches go through a workflow before they reaches me.

Q: What advice would you give to someone trying to attract people to a project?
A: If people can make money through your project, it will grow faster. We built a community on trust and respect; we make decisions on technical merit, not dollars. We have a darwinian model for ideas; bad ideas just die. See what rises to the top. Include it in the next version. Then put it into the core, if it’s worth it. The down side is that it’s very wasteful. I could tell people “If you do x, it will get in,” but I try to get out of the way. People have taken Drupal in sorts of directions, e.g., political campaigns, elearning platforms, etc.

Q: [me] How important are you to Drupal these days?
A: I think I’m more important as the face of Drupal than I used to be. In the governance sense I’m less important. I was the lead developer, the admin for the servers, etc., at the beginning. The “hit by a bus factor” was very risky. Nowadays, I don’t write code; I just review code. I still have a lot of work, but it’s much more focused on reviewing other people’s work and enabling them to make progress. If I were to die, most things would continue to operate. The biggest pain would be in the marketing . There are a lot of leaders in Drupal. One or two people would emerge or be elected to replace what I do.

Q: What’s hard for Drupal?
A: One of our biggest risks is to keep nimble and lean. It takes longer to make decisions. We need to continue to evolve the governance model to encourage us to accelerate decision making. Also, we have some real technical issues we need to address, and they’re huge projects. Volunteers can only accomplish so much. LSD is perfectly positioned to tackle the hardest problems. If we did it at the pace of the volunteers, it would take years.

Read the original blog entry...

More Stories By David Weinberger

David is the author of JOHO the blog (www.hyperorg.com/blogger). He is an independent marketing consultant and a frequent speaker at various conferences. "All I can promise is that I will be honest with you and never write something I don't believe in because someone is paying me as part of a relationship you don't know about. Put differently: All I'll hide are the irrelevancies."

@ThingsExpo Stories
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things’). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing? IoT is not about the devices, it’s about the data consumed and generated. The devices are tools, mechanisms, conduits. In his session at Internet of Things at Cloud Expo | DXWor...
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution. In his session at @ThingsExpo, Akvelon expert and IoT industry leader Sergey Grebnov provided an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.