Powered by Blogger.
RSS

Why Slack is right to be scared of Microsoft Teams

On the eve of Microsoft's November 2 event in New York, Stewart Butterfield, the co-founder of the San Francisco-based startup Slack decided to do something decidedly not digital. He took out a full page ad, along with an accompanying blog post, in the 165-year old New York Times with the headline: "Dear Microsoft".

It reads: "Wow. Big news! Congratulations on today's announcements. We're genuinely excited to have some competition."

The sarcasm of the ad is palpable, as the startup used one of the oldest forms of native advertising to welcome the behemoth enterprise software vendor into a market it appears to see as its own.

The ad goes on to offer some pretty patronising advice, but it does admit: "It's validating to see you've come around to the same way of thinking. And even though — being honest here — it's a little scary, we know it will bring a better future forward faster."

What the ad does show is that Slack is pretty convinced internally that Microsoft Teams is a ripoff of its product. It continues: "You're not going to create something people really love by making a big list of Slack's features and simply checking those boxes."

"How far you go in helping companies truly transform to take advantage of this shift in working is even more important than the individual software features you are duplicating."

Read next: Nine of the best enterprise collaboration software tools 2016: Slack, Workplace, Sharepoint and more

This is not Microsoft's first crack at enterprise communication and collaboration, and the software giant was even rumoured to be preparing a bid for Slack earlier this year.

Previously it had bought the "business social network" Yammer in 2012 for an eye-watering $1.2 billion and Skype in 2011 for $8.5 billion. Skype, of course, is a lot more than a messaging platform and the video and voice capabilities are where it really shines, however, the future of Yammer is less clear following the launch of Teams.

Yammer works more like Facebook than Slack, with users generally posting things rather than communicating in real time. It is nearly impossible to know how popular Yammer is, but sentiment seems to skew towards it not being a very popular product.

So, what is Microsoft Teams?

Microsoft calls Teams a "chat-based workspace" in Office 365. Each 'team' is like a Slack channel, where you can group employees together to discuss a topic and share and collaborate on documents. The advantage of Teams is that it naturally integrates with other Office 365 products like Word, Excel, Powerpoint, video conferencing with Skype and all of your files in Sharepoint.

Unlike the fairly stoic Skype for Business instant messaging platform, Teams comes complete with emojis, gifs and memes. Teams also allows for threaded chats. A common criticism of Slack is that chats can become disorganised, so finding a way to identify chats within chats would be a handy feature.

Integrations, integrations, integrations

While Teams will naturally work extremely well with Office products, it is increasingly important to integrate smoothly with all products as workers rely on more and more tools on a daily basis.

Slack said in its blog post: "The modern knowledge worker relies on dozens of different products for their daily work, and that number is constantly expanding. These critical business processes and workflows demand the best tools, regardless of vendor."

There are 750 apps in the Slack App Directory allowing for simple integrations with services like Twitter and GitHub. Microsoft says that it will have integrations with over 150 partners upon general availability early next year.

Despite the disparity in these numbers it is a strange swipe from a closed-source SaaS company like Slack, especially considering Satya Nadella's tenure as CEO has been a near-constant drive to open up Microsoft as a platform.

Slack wrote: "We know that playing nice with others isn't exactly your MO, but if you can't offer people an open platform that brings everything together into one place and makes their lives dramatically simpler, it's just not going to work."

My take

The truth is, with enterprise collaboration tools like this, the difference between the user experience will be minuscule. In an organisation of any size there will be people that like certain tools more than others, so the idea is to find one that works and to stick with it. However, because Teams is available to existing Office 365 users it is just another reason to stick with what they know.

Slack has been on a hot streak up to this point, growing to four million daily active users since the founders pivoted away from building a massive multiplayer game and into enterprise chat in 2009. The chat service admits that it is most popular in the technology and media industries, and has just 28 out of the Fortune 100 companies as customers. Office 365, on the other hand, has an existing user base of 85 million active monthly users.

It is not much of a leap of imagination to expect Slack's user growth to slow down. This might not be as a direct result of Microsoft's product, as much as a natural progression of the company as it rounds into maturity and the market becomes more crowded.

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS

Rolls-Royce uses Microsoft IoT tools to cut down on engine faults and fuel costs, and wants to sell the insights back to airlines

Rolls-Royce is using Azure Stream Analytics and Power BI to link up sensor data from its engines with more contextual information like air traffic control, route data, weather and fuel usage to get a fuller picture of the health of its aircraft engines.

Using Microsoft’s Azure IoT Suite to collect data, and Cortana Intelligence Suite to derive insights, Rolls-Royce will now go beyond predictive maintenance and into metrics that it can pass onto operations teams at airlines as a value added service. These insights are aimed at helping airlines to be more efficient when it comes to maintenance, aircraft choice and route selection.

A typical Rolls-Royce Trent engine - which can be found on the latest Airbus A380 and Boeing 787 Dreamliner aircrafts - will be fitted with 25 sensors, tracking everything from fuel flow, pressure and temperature to the aircraft's altitude, speed and the air temperature.

Even with airline fuel prices falling, revenue margins in the industry remain razor thin, meaning airlines are always looking for efficiency gains. Even a one percent saving on fuel costs would save an airline $250,000 per aircraft per year.

Read next: Singapore Airlines inks 5-year deal with Rolls Royce for fuel efficiency data analytics

ComputerworldUK sat down with Peter Chapman, head of capability at Rolls-Royce, during Microsoft's Future Decoded at London’s Excel this week to discuss how they are using the vendor's advanced analytics tools to manage the lifecycle of an aircraft engine, and create new revenue streams.

Beyond predictive maintenance

Predictive maintenance seems to be the buzz phrase around industrial internet of thing (IoT) use cases, but Chapman said that Rolls-Royce has a heritage of predictive maintenance, using home-grown analytics tools on small data sets and aggregating results out across a fleet for "many years now".

Instead, he wants to use the power of cloud-based technologies to "go beyond predictive maintenance and offer more services to our customers", such as using data to expand availability and efficiency services.

He added: "We have a long history of predictive and preventative maintenance and now we are looking at how our customers are actually flying the engine: what routes are they taking, what weather impacts those routes, can we help advise them to have a more efficient route plan or even an aircraft choice or engine?"

Rolls-Royce uses Microsoft's newly blended CRM and ERP tool Dynamics 365 to aggregate data across these various sources. Chapman said: "Traditionally, like many businesses we have many different technologies with data silos. Using Azure and Dynamics we are aggregating those data sets, providing a single view of the customer, or a single view of the maintenance of an engine."

Chapman says that Rolls-Royce's team of data scientists apply machine learning algorithms to these expanded data sets to spot patterns and identify operational efficiencies which could then be passed on to the customer.

Read next: Rolls-Royce moves global HR into the cloud with Workday

Now the company is looking at ways to sell this operational insight into its customers. "It is something we will be discussing with the airline customers about the best ways of monetising that, if we do," Chapman said.

This access to metrics fits with the companies move towards a more service-oriented business model, called TotalCare, which essentially means licensing engines to airlines to maintain perpetual revenue.

Cloud

Chapman says that Rolls-Royce sees its future firmly in the public cloud and that they chose Microsoft instead of rivals like AWS or Google Cloud because of its suite of tools and enterprise track record.

Read next: Microsoft Azure vs Amazon AWS public cloud comparison: Which cloud is best for the enterprise?

"We don't want to focus on a lot of the plumbing and more on the analytics and the customer outcome," Chapman explained. Rolls-Royce was also attracted to Azure's regional strategy because "regional data centres help us with regulated markets, export control regulations, data sovereignty", Chapman explained.

To sum up Chapman said: "The goal really is to make sure that every Rolls-Royce powered aircraft takes off and completes its mission as planned in the most efficient way possible. So it is ensuring the availability of the aircraft. [Airlines] would see increased reliability and availability, as well as fuel efficiency and general operational performance."

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS

Snooper's Charter: What you need to know about the Investigatory Powers Bill

Updated 2 Nov 2016: The Investigatory Powers Bill has passed the third reading in the House of Lords and will be passed into law by the end of the year, following final consideration of amendments and Royal Assent.

Concerns around the balance between privacy and security have apparently been sufficiently quelled in Parliament's second chamber by an amendment which states: "This Act sets out the extent to which certain investigatory powers may be used to interfere with privacy."

Lord Janvrin - who proposed the amendment - said of its approval: “That there is merit in placing a simple statement right at the forefront of the legislation to provide additional clarity that there should be no doubt that privacy protection remains a fundamental priority.”

To save you scrolling here are the main powers the bill brings into law:

Web and phone companies (CSPs) will store records of websites visited by every citizen for 12 months for access by police, security services and other public bodies upon issue of a warrant.

Security services will be legally empowered to bug computers and phones upon approval of a warrant. Companies will be legally obliged to assist these operations and bypass encryption where possible (more on this below).

Security services can acquire and analyse bulk collections of communications data. For example, this could mean a bulk data set such as NHS health records.

Oversight for these operations will come with a new “double-lock”, where any intercept warrants will need ministerial authorisation before being judged by a panel of judges, who will be given power of veto. This panel will be overseen by a single senior judge, the newly created Investigatory Powers Commissioner.

Read on for what the bill includes, the safeguards put in place and the criticism it has faced over the past twelve months.

Update 19 July 2016: Concerns over the government's approach towards encryption have reemerged during the second reading of the Investigatory Powers Bill in the House of Lords last week (you can read the entire debate here).

Earl Howe, minister of state for defence and deputy leader in the House of Lords, said: "It may be entirely sensible for the government to work with [communication service providers] to determine whether it would be reasonably practicable to take steps to develop and maintain a technical capability to remove encryption that has been applied to communications or data."

“Law enforcement and the intelligence agencies must retain the ability to require telecommunications operators to remove encryption in limited circumstances," he said.

Read next: The Snooper's Charter still has an encryption problem

However, Nic Scott, managing director UK and Ireland at enterprise data security specialists Code42, makes the important observation that there are no "half measures" when it comes to encryption. He says: "You either have encryption in place or you don’t. Once you create a backdoor for law enforcement purposes, you are also opening the door to other, potentially malicious, parties."

Update 8 June 2016: The Investigatory Powers Bill was comfortably voted through its third and final reading in the House of Commons, with 444 MPs voting in favour to 69 against. It will now be sent to the House of Lords to be scrutinised by peers.

This comes after the Labour Party said that the bill had met the significant demands made by shadow home secretary Andy Burnham back in March.

Significant Demands

Update 16 March 2016: The shadow home secretary Andy Burnham laid out six areas of concern for the Investigatory Powers Bill back in March: “If the government fails to respond adequately to the concerns that I have raised,” he said, then the Labour party will withdraw its support for the timetabling of this bill. The current timetable as laid out by the government is to pass the bill into law by the end of 2016.

Speaking at the second reading of the bill, Burnham said: “This bill isn’t yet good enough. Simply to block this legislation would in my view be irresponsible, it would leave police and security services in limbo. We must give them the tools to do their job. The public interest lies in getting this right and in not sacrificing quality to meet the deadline.”

I want to see major changes to #IPBill. Will set out plan later to get them. My judgment is this will achieve more than outright opposition.

— Andy Burnham (@andyburnhammp) March 15, 2016

The six concerns are as follows:

1. Privacy: “The Home Secretary said [privacy] was hardwired into the bill, but I see them as more cosmetic changes and haven’t directly answered the concerns of the joint committee.” Burnham asked that the bill takes a “presumption of privacy”.

2. Specific powers: “Internet connection records (ICRs) have been described as the modern equivalent of an itemised phone bill, however the joint committee noted that this is not a helpful description.” Burnham went on to explain that there should be a “higher hurdle” for use of this power limited to cases of serious criminal activity rather than any crime. He also asked that the terms “national security” and “economic wellbeing” are defined more explicitly.

3. Internet Connection Records: “Definitions of ICRs (Clause 54) remain vague and I see them becoming more intrusive as technology advances. A stricter definition of what can be included in an ICR should be included. The current confusion is clouding this bill and needs to be clarified.”

4. Bulk Powers: “Routine gathering of large quantities of information from ordinary people does lead to privacy concerns and should be as targeted as possible […] It is for the government still to convince the public that these powers are needed.” Burnham asked specifically for an independent review to conclude in time for report and third reading on this issue.

5. Judicial oversight: “The government has given significant ground on this issue and the bill is stronger as a result, however we believe it could be stronger still […] I have previously shared concern that this leads to a narrower test looking at only the process and reasonableness of the home secretary’s decision, rather than actual merits and substance of the warrant.”

May had earlier reassured the house that judicial commissioners will have access to the same information about a warrant as the home secretary. Burnham recognised this, but continued: “If this is the case why not delete the judicial review clause? To make it absolutely clear that this is not just a double lock, but an equal lock.”

6. Misuse of the powers: “There needs to be safeguards for the collection of data in a lawful manner and we must also agree that there needs to be an overarching law for the obtaining of data and any use that data is subsequently put to. Both should be a criminal offence.”

What next? The bill now enters the committee stage, where the government has the opportunity to make amendments following the issues raised during the second reading. The bill will then return to the House of Commons for the report stage, where MPs have their final opportunity to debate and vote on the bill ahead of the third and final reading and vote.

First reading

The Home Office published the investigatory powers bill on March 1. Following criticism from three joint committees: the science and technology committee on February 1, the intelligence and security committee on February 9 and most importantly, the joint committee for the bill itself on February 11, Home Secretary Theresa May claimed that the revised bill "reflects the majority of the committees’ recommendations.”

The joint committee for the draft investigatory powers bill made 86 recommendations for changes to the bill in its report, concentrating on issues of clarity, judicial oversight and justification of the various powers. For a summary of these suggestions skip ahead one section.

Addressing these specific concerns, May said of the revised bill: “We have strengthened safeguards, enhanced privacy protections and bolstered oversight arrangements.”

Not everyone agrees with this assessment though. Dr. Gus Hosein, executive director of Privacy International said: “It would be shameful to even consider this change cosmetic […] The continued inclusion of powers for bulk interception and bulk equipment interference - hacking by any other name - leaves the right to privacy dangerously undermined and the security of our infrastructure at risk.”

The headlines

When the bill was first proposed Clause 71 led the news agenda. This requires web and phone companies (CSPs) to store records of websites visited by every citizen for 12 months for access by police, security services and other public bodies.

In practice this would take the form of an itemised list of each citizen’s browsing history. This would not be a list of the specific web pages but the main domain (so computerworlduk.com but not the specific stories you read) so a basic online footprint can be drawn up. One concern here will be around the security of this data, especially in the current climate of TalkTalk customer hacks and data dumps.

The bill seeks to make the power for security services to acquire bulk collections of communications data explicitly legal. For example this could mean a bulk data set such as NHS health records.

Security services will also be legally empowered to bug computers and phones upon approval of a warrant. Companies will be legally obliged to assist these operations and bypass encryption where possible (more on this below).

The science and technology joint committee report tackles the possibility of public concern over the power to hack devices, stating: “The tech industry has legitimate concerns about the reaction of their customers to the possibility that electronic devices could be hacked by the security services,” before stating that the government has a responsibility to inform the public about the extent to which this power may be used.

Oversight for these operations will change, with a new “double-lock” where any intercept warrants will need ministerial authorisation before being judged by a panel of judges, who will be given power of veto. This panel will be overseen by a single senior judge, the newly created Investigatory Powers Commissioner.

For some context, figures from the Home Office, as published by The Guardian, show there were 517,236 authorisations in 2014 of requests for communications data from the police and other public bodies and a further 2,765 interception warrants authorised by ministers.

The joint committee report

The joint committee for the bill issued its report, along with a list of suggested amendments for the bill, on February 11. The suggestions include:

- Clarification over the concept of end-to-end encryption: “The Government still needs to make explicit on the face of the bill that Communications Service Providers (CSPs) offering end-to-end encrypted communication or other un-decryptable communication services will not be expected to provide decrypted copies of those communications if it is not practicable for them to do so.”

Update 4/3/16: On the issue of encryption the government says the revised bill: “Clarifies the government’s position on encryption, making it clear that companies can only be asked to remove encryption that they themselves have applied, and only where it is practicable for them to do so.”

- CSPs being forced to retain internet history data of users should be provided with "whatever technical and financial support is necessary to safeguard the security of the retained data" but the government shouldn’t be responsible for 100 percent of the costs.

Update: 31/3/16: The Don’t Spy On Us coalition, which includes the Open Rights Group and Privacy International, has said: “Proposals to collect the internet connection records (ICRs) of every UK citizen could cost more than £1 billion.” This figure is based on a similar scheme which has since been dropped in Denmark due to the cost. The initial Home Office estimate for the storage of these records was just £174m over ten years.

- "Fuller justification" for bulk surveillance: "We believe that that the lack of a formal case for bulk personal datasets (BPDs) remains a shortcoming when considering the appropriateness of this power."

- There should be no power to ask foreign intelligence agencies to undertake surveillance where the UK authorities cannot, for example in the USA.

Update 4/3/16: The revised bill "explicitly bans our agencies from asking foreign intelligence agencies to undertake activity on their behalf unless they have a warrant approved by a Secretary of State and Judicial Commissioner."

- Hacking should be targeted: "Targeted interception and targeted equipment interference warrants cannot be used as a way to issue thematic warrants concerning a very large number of people."

- An annual report that must contain: "Information about the impact, results and extent of the use of powers in the bill so effective public and parliamentary scrutiny of the results of the powers can take place."

Writing for Wired.com, Liberal Democrat MP Lord Strasburger, who sat on the joint committee, said: "This bill is a long way from the finished article. It needs more than mere tweaking, it needs to be fundamentally rethought and rebuilt. The Home Office should stop rushing to push it through and take its time to get it right."

The intelligence and security committee criticised the bill for a lack of clarity and transparency around powers and suggested wide ranging amendments to the bill. Mostly though the committee says that the bill could benefit from starting again, saying: "The draft bill adopts a rather piecemeal approach, which lacks clarity and undermines the importance of the safeguards associated with these powers.

"We have therefore recommended that the new legislation contains an entirely new part dedicated to overarching privacy protections, which should form the backbone of the draft legislation around which the exceptional powers are then built. This will ensure that privacy is an integral part of the legislation rather than an add-on."

The science and technology select committee report confronted concerns over the impact the legislation could have on the UK’s technology sector; equipment interference powers and a lack of clarity when it comes to the issue of encryption.

Nicola Blackwood MP, chair of the science and technology committee said: "It is vital we get the balance right between protecting our security and the health of our economy. We need our security services to be able to do their job and prevent terrorism, but as legislators we need to be careful not to inadvertently disadvantage the UK’s rapidly growing tech sector."

The joint committee on the Draft Investigatory Powers Bill was sent 148 sets of evidence raising concerns and views about aspects of the legislation, and May faced questions over these concerns in front of the committee in December.

The politics

There was generally cross-party approval of the bill as first proposed, with Shadow Home Secretary Andy Burnham stating that it was “neither a snooper’s charter nor a plan for mass surveillance.”

Conservative MP David Davis has been one of the more outspoken critics of the proposed legislation. Talking to The Guardian he said: “In every other country in the world, post-Snowden, people are holding their government’s feet to the fire on these issues, but in Britain we idly let this happen […] Because for the past 200 years we haven’t had a Stasi or a Gestapo, we are intellectually lazy about it, so it’s an uphill battle.”

Author and journalist Heather Brooke went one step further. Writing for The Guardian she said: “The spies have gone further than [George Orwell] could have imagined, creating in secret and without democratic authorisation the ultimate panopticon. Now they hope the British public will make it legitimate.”

Edward Snowden tweeted: “By my read, #SnoopersCharter [The Draft Investigatory Powers Bill] legitimises mass surveillance. It is the most intrusive and least accountable surveillance regime in the West.”

Apple submitted a formal submission to the bill committee, specifically around the issue of encryption, on Monday 21 December, expressing: “We believe it would be wrong to weaken security for hundreds of millions of law-abiding customers so that it will also be weaker for the very few who pose a threat. In this rapidly evolving cyber-threat environment, companies should remain free to implement strong encryption to protect customers,” as per The Guardian.

According to YouGov the UK public generally approve of surveillance, with 44 percent of respondents stating it wouldn’t bother them to know that they could be spied upon and they don’t think they are at this time.

Obligations on communications service providers

The use of investigatory powers relies heavily on the cooperation of so-called 'communications service providers' (CSPs) in the UK and overseas. The draft bill clearly outlined a legal duty on British companies to assist in hacking devices (equipment interference warrants).

On the issue of data retention May told the joint committee in January that: “There have been discussions with providers. CSPs have shown me responsiveness on that matter.” However, she avoided giving any detail on how this would work in practice and how much it might cost, saying: “There are no exact figures, I’m happy to provide written evidence of Home Office work in this area.”

The science and technology joint committee report pushed the government for greater clarification when it comes to practical concerns around the retention of this data. The report reads: “There seems still to be confusion about the extent to which ‘internet connection records’ will have to be collected. This in turn is causing concerns about what the new measures will mean for business plans, costs and competitiveness.”

The joint committee has pushed the government to provide: "Whatever technical and financial support is necessary to safeguard the security of the retained data" in its report, but suggests that the government shouldn’t be responsible for 100 percent of the costs.

A spokesperson for UK internet service provider (ISP) BT responded to this obligation by stating: “National security is a critical issue and everyone needs to play their part, including industry. Parliament has long taken the view that the national interest is best served by allowing security and law enforcement authorities access to certain types of data under certain circumstances. We believe there must be a clear legal framework around this regime, one that ensures adequate checks and balances are in place to weigh up any human rights concerns.”

ISP Virgin Media said it “does not monitor or control what customers do online but complies with all lawful requests. It is for Parliament to decide where the balance lies between the needs of law enforcement and citizens’ privacy.’’

ISPs have been cooperating with requests like this since 1984 under obligations outlined in the Telecommunications Act, if requested by the Secretary of State in the interest of national security. This bill looks to write this power into law for the security and intelligence agencies.

The draft bill also outlined a means for ISPs, telecommunications operators and postal operators to receive appropriate contributions to cover the additional costs of these activities.

These providers can appeal requests for data, but only directly to the Secretary of State.

Encryption

Theresa May has been criticised for her response to the issue of encryption in the bill.

The issue for the security services would be that over the top communications services, like Apple’s iMessage and the popular WhatsApp messaging service, apply end-to-end encryption to all messages, meaning they can’t read them even if they wanted, or were asked to.

In Apple's formal submission to the bill commission the company voiced concern that: "Passages in the bill could give the government the power to demand Apple alters the way its messaging service, iMessage, works" in a way that gives security services the power to eavesdrop on messages, according to The Guardian. Apple CEO Tim Cook has been consistently outspoken in his defense of encryption.

Emails sent using Microsoft Outlook aren’t automatically encrypted in this way and Gmail requires an end-to-end encryption extension for Chrome. Blackberry offers end-to-end encryption between devices through its paid BBM Protected product. The Cisco Spark messaging service has built in end-to-end encryption.

Privilege

The draft bill specified sensitive professions, namely medical doctors, lawyers, journalists, Members of Parliament and the devolved legislatures, and Ministers of Religion, who will be afforded extra protections under a new code of practice. The safeguards appear to be limited though, with the new judicial authorisation cited, along with the added obligation to ensure that the information being investigated is in the public interest.

In its suggestions for the bill, the joint committee report went further on the issue of privilege, recommending: “That extra protections for privileged and confidential communications should be applied in the same way as is proposed for journalists.”

What next?

The Investigatory Powers Bill has passed the third reading in the House of Lords and will be passed into law by the end of 2016, following final consideration of amendments and Royal Assent.

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS

Google's global data centre chief touts environmental benefits of cloud computing shift

The shift towards cloud computing will have environmental benefits as inefficient corporate data centres and server rooms are replaced by 'hyperscale' cloud facilities, according to Google's global head of data centre infrastructure.

Along with companies such as Microsoft, Amazon and Facebook, Google owns some of the largest and most power-hungry data centres in the world. It already runs 15 hyperscale facilities globally, with four in Europe - and plans expansions next year as it targets enterprise business users, as well as supporting search services, YouTube and more.

However, due to the scale of their operations and their ability to customise infrastructure, these hyperscale providers tend to be the most energy efficient, and are increasingly making use of renewable energies such as wind and solar power.

Speaking at Data Centre Dynamics' Zettastructure event in London today, Google's Francois Sterin said that accessing cloud services will result in an overall improvement in terms of energy consumption, while demand continues to grow.

Sterin cited a 2013 report from University of Berkeley, California, which claims that moving business applications used by 86 million office workers in the US to the cloud would reduce energy consumption by 87 percent.

"[This is] because they are moving from an on-premise, couple of racks, couple of closets [environment] to public data centres that are optimised and run to be energy efficient," Sterin said. "That actually means powering the city of Los Angeles with that [energy saved]."

He added: "The move to cloud is going to be a big driver in terms of reducing the overall consumption, and making sure that the data centres grow in a sustainable way."

Sterin went on to say that overall efficiency gains will be enabled by what Berkeley researchers have termed the 'hyperscale shift'.

In a paper from June this year, the researchers posited a scenario where 80 percent of servers in small data centres move to the data centres operated by the likes of Google and its competitors. This could result in a 25 percent reduction in energy consumption by 2020, compared to the current usage trends.

Sterin said: "It could go from 70 TW hours to less than 50, if you take a more aggressive shift to the cloud solution. This is going to happen in Europe and the rest of the world."

AI reducing power consumption

Sterin highlighted some of the various techniques Google has used to reduce its data centre power consumption in the past 15 years, such as building its own power supplies.

"In 2001 we started designing our own power supply for the servers," he said. "We realise that the manufacturer didn't have any incentive to reduce the consumption because they don't pay the power bill. We pay, so therefore what we did was partner with power supply specialists to increase the efficiency of such power supply from say 60 percent to 90 percent."

Most recently it has looked to artificial intelligence to find further gains by optimising its power usage effectiveness measurement (PUE). 

First this involved a Google engineer building algorithms around 20 parameters, such as outdoor wind direction

"Sometimes it is used as a joke, like nobody cares about the outdoor wind direction, but in that case we care about it," Sterin said. Then attention turned to the expertise at Google's DeepMind division.

"Some of [DeepMind's] guys worked with our data centre facilities team to even further improve that, not taking 20 parameters but 120 parameters to increase more," Sterin said.

"The combined first approach plus the DeepMind expertise could even further improve the PUE to 1.06 or 1.05 or something like this.

"It is beginning to be rolled out so we don't necessarily have the full data yet on how it works in practice. But the simulation on some pilots shows that it's helping to reduce the cooling electricity by another 40 percent."

'Environmental benefits not just green-washing'

Google is aiming to use 100 percent renewable energy in the future. It mostly relies on wind power, due to cost, but Sterin said that solar energy is quickly becoming a viable alternative. It is also open to using other sources, such as biomass.

Sterin acknowledged that when large companies discuss 'green' initiatives, it is often perceived as PR.

"A lot of people say it is just about 'green-washing': when you procure renewable energy, when you want to be 100 percent renewable, it is just about having a good brand and to have a good image," he said.

The reality, he added, is that while the company wants to be seen as a leader in tackling climate change, there are clear cost and budgetary gains too.

"It is also about making sure that we have cost competitive supply of energy," he said. "Especially in Europe for instance price of power has been very volatile."

"The finance guy I have in the US says he doesn't understand all that volatility, he wants a fixed price like he is used to. So what do you do? We found that renewable energy was the way to achieve that as well.

"So the message here is that renewable energy is important but it also makes business sense."

This makes sense for customers too. 

"As we are moving more and more to being a cloud provider, most of the customers will be interested in having a very clear power supply or clear solution," he said.

"More than half of the Fortune500 companies have corporate responsibility goals and that is why you have seen all the DC providers and all the hyperscale providers getting into those renewable energy deals," he explained. "You do this because your end customer will also have some goals in renewable energy."

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS

Graph database vendors: Who they are, what they do and who their customers are

Graph databases are growing in popularity in the enterprise space. According to Forrester analyst Noel Yuhanna in his market overview the graph database market is "embryonic but will grow significantly”.

Read first: What is a graph database? Vendors, use cases and customers explained

Gartner started including graph database vendors in its magic quadrant for operational database management systems (ODBMS) in 2014 with the inclusion of Neo4j and GraphDB and also expects to see more entrants in the coming years.

A quick recap on what a graph database is first:

A graph database is a flavour of NoSQL database built upon graph theory, an academic __computer science methodology which plots data points, known as objects or nodes, and the connections between them on a 'graph'. So, where a traditional, relational database stores data in rows and columns, a NoSQL database stores large sets of unstructured data. A graph database goes a step further by including the connections between those data points, essentially building up a network of data.

Here are some of the leading graph database providers in the market right now, from open source to established vendors and a few noteworthy pilots worth keeping an eye on…

1. Neo Technologies

Neo Technologies
© Neo4J

Swedish co-founder and CEO of Neo Technologies Emil Eifrem started building graph databases eight years ago when he realised the limations of relational database technology as he built content management systems for enterprise customers.

He explains: “The key reason it was working against us is because the information we were working with didn’t really fit, the information was big and messy and interconnected and ever changing and evolving.”

Read next: The Panama Papers - how big data blew the lid on global elite's financial secrets

The result was Neo4j, one of the first commercially available graph databases with a broad range of customers. Eifrem says: “When it comes to actual customers we now see this very horizontally across any aspect of the software industry. So we have a lot of pure software companies.

"Also financial services, retail, media and entertainment and social networks are an obvious example, telecoms and healthcare.”

2. DataStax

DataStax
© iStock

DataStax announced its graph database product at its London summit in April 2016, adding it to its existing DataStax Enterprise platform, DSE, which is built on Apache Cassandra.

CEO Billy Bosworth told ComputerworldUK: “Think of [Cassandra] as our backbone. We can now do things like model the data differently on top of it, introduce different workloads like search indexing, real-time analytics, basic transactions. Here’s the real key: to never have any of those collide.”

The addition of graph comes on the back of DataStax’s acquisition of open-graph database specialists Aurelius and is essentially a new version of its Titan database.

Speaking at the DataStax summit, Matthias Broecheler, director of engineering for DSE Graph said: “DataStax Enterprise Graph is us taking the ideas from Titan and placing them on an enterprise grade platform.”

DataStax aren’t publishing any customers for this product yet but Dutch bank ING has shown an early interest.

3. Oracle

Oracle
Larry Ellison © Oracle

Oracle offers spatial and graph options for its flagship database product. Oracle has a first mover advantage over competitors like SAP and IBM as one of the first major IT vendors entering the graph database space over two years ago for its NoSQL database.

Oracle’s Big Data Spatial and Graph analytics tools are Apache Hbase and Oracle NoSQL database compliant.

Oracle has a property graph, as well as an RDF graphs and network data model graph. The Oracle solution tends to be used more for knowledge management; so metadata, taxonomy and ontology, with customers like Bloomberg and Thomson Reuters attesting to these use cases.

Oracle says the product is good for: “Social network analysis to linked open data and network graphs used in transportation, utilities, energy and telcos and drive-time analysis for sales and marketing applications”

4. OrientDB

OrientDB
© iStock

OrientDB has also been recognised by Gartner in its Operational DBMS Magic Quadrant, alongside Neo4j. According to OrientDB themselves the database is different from Neo4j’s, in that: “While Neo4j is a pure graph database, OrientDB has a hybrid document-graph engine that adds some compelling features to the graph database model.

OrientDB was first released in 2010 and the open-source database supports schema and schemaless modes. Similar to DataStax, Orient is keen to be seen as a multimodel engine for a range of use cases, be it transactional or operational for fraud detection, customer 360 and social networking.

Customers deploying OrientDB include CenturyLink, Ericsson, Pitney Bowes, Sky, and Warner Music.

5. MongoDB

MongoDB
© MongoDB

NoSQL database vendor MongoDB brought graph database capabilities to its customers with its 3.4 update in November 2016. Now developers can access and store data in graph and faceted search query languages without using a specialist vendor. This allows for new data sets to be analysed and queried alongside other operational data held in MongoDB, without the need for data duplication.

A white paper by the vendor states: “Applications storing data in MongoDB frequently contain data that represents graph or tree type hierarchies. These connections can be as simple as a management reporting chain in a HR application, or as complex as multi-directional, deeply nested relationships maintained by social networks, master data management, recommendation engines, disease taxonomy, fraud detection, and more.”

The update brings native graph analytics and faceted search directly to customers, and fully integrates with existing security, management, availability and disaster recovery capabilities.

6. Complexible

Complexible
Stardog © Complexible

Stardog is the ‘smart graph database’ from US-software company Complexible. Stardog has a particular focus on OWL and RDF-based systems, with the latest release supports the SPARQL and Gremlin query languages. A key feature for Stardog is graph versioning to track changes.

Featured customers include NASA, JP Morgan Chase and Viacom. Stardog is priced for community, developer and enterprise tiers, with community free to download and use for up to four users and ten databases.

7. Franz

Franz
© iStock

AllegroGraph is software developed by semantic web specialists Franz Inc. According to Forrester’s Noel Yuhanna: “Franz is the key developer, contributor, and supporter of AllegroGraph, a semantically enhanced graph database that focuses on W3C standards and is commercially licensed with open source extensions.”

The AllegroGraph product has a strong use case for event processing where “applications benefit from ontologies, reasoning, rules, and linked open data”, says Yuhanna.

AllegroGraph supports SPARQL, RDFS++, and Prolog reasoning and clients include Goldman Sachs, Pfizer, Siemens and Wells Fargo.

8. FlockDB

FlockDB

Flock started out as an open-source project at Twitter and lives on through GitHub, where developers can use the software for social media and web-site use cases.

According to its GitHub page: “FlockDB is much simpler than other graph databases such as Neo4j because it tries to solve fewer problems. It scales horizontally and is designed for on-line, low-latency, high throughput environments such as web-sites.”

9. Objectivity

Objectivity
© iStock

Objectivity Inc, as the name suggests, started life in the niche object database space and went on to create InfiniteGraph.

The US software maker has since been busy creating a new graph database product called ThingSpan, focused on industrial internet of things (IoT) use cases.

ThingSpan is built to bring graph capabilities natively in to Apache Spark and the Hadoop Distributed File System (HDFS). Users can run mixed workloads on massive data sets, including navigation and pathfinding queries as well as parallel pattern-finding and predictive analytics.

A note on the Objectivity website reads: “InfiniteGraph is a highly specialized graph database. Its functionality is being migrated into ThingSpan. However, Objectivity will continue to support licensed users and will recommend it to Java developers who wish to use graph analytics outside of a Spark environment.”

10. Teradata

Teradata
© iStock

Teradata’s Aster SQL-GR is a native graph processing engine so developers can run complex graph analysis on their data, based on bulk synchronous processing. Teradata says that Aster allows users to run graph analysis in parallel with text and statistical.

Like Oracle, Teradata stands out on this list as it isn’t traditionally an open-source company. Aster analytics can be installed on native hardware and an appliance, on the Teradata cloud or on Hadoop.

Use cases include: social network/influencer analysis, fraud detection, supply chain management, network analysis and threat detection and money laundering.

11. Microsoft

Microsoft
© Microsoft

Microsoft Research has been working on a graph project, previously named Trinity, since 2012, and finally released Graph Engine 1.0 for public preview in May 2015.

Graph Engine is available to Microsoft customers through Visual Studio and on the Azure cloud.

12. Apache

Apache
© Apache Foundation

Apache's Giraph project has also been in development since 2012. According to the Apache Foundation, it is: “An iterative graph processing system built for high scalability. For example, it is currently used at Facebook to analyse the social graph formed by users and their connections.

"Giraph originated as the open-source counterpart to Pregel, the graph processing architecture developed at Google.”

Being open source Giraph is available for download to all and Apache says: "Pre-built packages will soon be available through Apache's Maven repositories, making it easier to include Giraph in your projects."

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS

How to become an OpenStack engineer - tips from the community on how and why to get started with the cloud platform

Open source cloud platform OpenStack just finished up its biannual summit in Barcelona, Spain last week. There was a consensus that the community has reached a point where it is now not only enterprise-ready but in use for a wide variety of reasons and all over the world.

Regardless, there are still some preconceptions about OpenStack: that it is overly complex, or that there is so much noise from so many vendors it's hard to know where to begin. Another challenge, tied intrinsically to these, is that it can be difficult to find the right people – so it's arguably a shrewd move to get acquainted with the technology as a career move.

Suse's Alan Clark, director for industry initiatives, emerging standards and open source, is also chairman of the board of directors at the OpenStack Foundation. And according to Clark, becoming an OpenStack engineer is a "great career move" for a couple of reasons.

"Centring your career on open source is a smart career move because most employers today are scrambling to embrace open source in research and product development," Clark says. "With open source adoption comes the need for skilled engineers, so open source experience on a resume is a great asset in today's market."

Clark adds that it doesn't take much more than a cursory glance of job boards to see the demand for not only open source, but OpenStack talent.

"The OpenStack ecosystem continues to grow and expand – demand will continue to grow for several more years," he says.

See also: 451 cloud pricing report suggests OpenStack breakthrough

"OpenStack engineering opportunities will continue to grow and evolve with the advent of additional innovation and technologies," Clark says. "That spells opportunity for OpenStack engineers to tailor and grow their knowledge, experience and job focus."

One that OpenStack Foundation executive director Jonathan Bryce concedes is tough can be finding qualified engineers in the first place.

"Many organisations are already using OpenStack to automate their infrastructure but finding qualified engineers can be a challenge," Bryce tells Computerworld UK. "For someone who has built a career administering servers and networks, there's a huge opportunity right now to extend their skills into the cloud world. OpenStack is available directly from all the major Linux distributions, as well as other commercial and free versions – the barrier to entry to start learning is very low."

Anyone with knowledge of administering Linux servers or virtualised environments will already have a decent baseline of knowledge for moving over to OpenStack, Bryce said. Once that interest is piqued, there are resources online and in person where you can better acquaint yourself with the ins and outs.

Bryce suggests finding local user groups to attend meetups - there are regular meetings in many of the world's major cities. The Foundation has made books and documentation available for free online too, such as the Operations Guide, available here. 

Bryce goes on to recommend more in-depth training, such as the Academy workshops running during the OpenStack Summit – and outside of the Summit there are in-person bootcamps available or courses from other official OpenStack training providers, listed here. 

See also: Yes, OpenStack is enterprise ready but it will need to keep up the momentum

Practically speaking, like Bryce, Suse's Alan Clark points to the community itself for engineers starting out.

"There is a large array of detailed technical information and roadmaps available through the community web interfaces," Clark says. "This is a great place to start learning – but also there is open access to the mailing lists and community events, like the Summit we just had in Barcelona."

"Once an engineer has a basis of information, I recommend they reach out to projects of interest and begin to involve themselves," adds Clark. "It can be quite educational, and career enhancing, to contribute to a project – there's a wide range of opportunities available."

"And I'd also strongly recommend demonstrating gained knowledge and expertise through a successful completion of the Certified OpenStack Administrator programme," he says. "This provides real evidence of proficiency to a future employer – tying this with a history of contribution conveys a unique skill set and experience that will be a huge differentiator in today's market."

"You can build your own OpenStack cloud using packages from free community distributions like Ubuntu, Debian, OpenSUSE, or Fedora," Jonathan Bryce adds. "Or commercial versions of the most widely deployed projects, Keystone, Nova, Cinder, Glance, Neutron, Swift, and Horizon, and improve your knowledge of running OpenStack services in a more real-world configuration."

Bronsilav Kantor is a solution architect at Finnish IT services business Tieto, and he had real experience of getting to grips with OpenStack through a practical deployment with professional training, and his own initiative, running parallel to this.

Tieto began working on a cloud project a few years ago, including a portal for users to deploy and manage applications – Tieto deployed OpenStack internally and then began building an OpenStack cloud in its lab too.

"I was looking for some information, some skilled people, but there weren't so many," Kantor says. "So I tried to find some good training and found Mirantis – it was good, although it didn't cover all of my expectations – but I found very skilled people and participants. It was interesting to share the experience between us."

Kantor does warn that the OpenStack landscape can be a little daunting at first. "There are so many services in OpenStack that it's hard to find the services you should select," he says. "Fragmentation of OpenStack is too big – I don't have enough time to follow all the news."

But his experience of the training was overall positive. "There were some nice lectures about debugging OpenStack, which is needed," he says. "If you have any problems it can be a stressful situation, so we learned a lot about how to solve your problems quickly on this training."

"I think practising is important," he says. "You should have courage, just install it and use it. I think some engineers don't have enough patience, and motivation is important. If you really want to achieve something, you can learn it from OpenStack documentation – I did it like that. The training was more to confirm that I understand it well enough."

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS

Nine of the best enterprise collaboration software tools 2016: Slack, Workplace, Sharepoint and more

Enterprise collaboration software is transforming the way colleagues communicate and becoming an essential business tool.

The world's largest software maker is also probably the biggest provider of enterprise collaboration tools, but Microsoft recently hiked its enterprise cloud prices by 22 percent. Its competitors offer a tempting array of alternatives waiting to challenge for your cash. Here's our pick of the best ones available.

Read next: 11 free collaboration tools and project management applications 2016

1. Best enterprise collaboration software tools: Facebook Workplace

Best enterprise collaboration software tools: Facebook Workplace
Image: Facebook

The social media juggernaut recently made its move from the private sphere into the professional one with the launch of Workplace.

Workplace combines the familiar Facebook interface and functions including Messenger chat and the news feed with new tools including a dashboard with analytics.

Workplace costs $3 (£2.45) for each of the first 1,000 monthly active users, $2 (£1.63) per employee from 1,001 to 10,000 users and $1 (£0.82) for every additional user.

2. Best enterprise collaboration software tools: Yammer

Best enterprise collaboration software tools: Yammer
Image: Yammer

Microsoft entered the enterprise collaboration market with the £752 million purchase of Yammer in 2012.

Yammer lets companies compile messages, files and updates in a single destination and boots information sharing through conversation groups. Users can interact in either open public groups or private ones for sharing sensitive information.

Yammer's Enterprise Standalone costs $3 (£2.45) per month for each user. The Office 365 for Business version starts at a monthly fee of $5 (£4.08) per user.

3. Best enterprise collaboration software tools: Huddle

Best enterprise collaboration software tools: Huddle
Image: Huddle

File management is one of the big strengths of Huddle. Users can control document approvals, share files, collaborate on content and manage projects on the cloud collaboration platform.

At $20 (£16.35) for each user per month for the "Essential" package and $40 (£32.70) for the "Plus" version, Huddle is at the pricier end of the market, but it does come with an impressive array of features.

4. Best enterprise collaboration software tools: Slack

Best enterprise collaboration software tools: Slack
Image: Slack Technologies

Slack's real-time messaging across an attractive interface and easy integration with familiar applications such as Skype, Google Drive and Twitter makes it a user-friendly choice for workplace communication.

The products costs $6.67 (£5.45) per user for the "Standard" service and $12.50 (£10.21) for the "Plus" package. Slack is also available in a free trial version for companies, but services such as unlimited message storage and group phone calls are not included.

5. Best enterprise collaboration software tools: LoopUp

Best enterprise collaboration software tools: LoopUp
Image: LoopUp

London startup LoopUp has become the go-to platform for conference calls. Users can see who is speaking in real-time and have no need to dial into the call, while call leaders can mute participants when necessary.

LoopUp offers two pricing structures for customers: a pay-as-you-go option with cost dependent on volume of minutes or a licence fee per month, with the price negotiable based on number of licences.

6. Best enterprise collaboration software tools: Cisco Spark

Best enterprise collaboration software tools: Cisco Spark
Image: Cisco Spark

The Spark messaging service includes text, voice, video, text, and content sharing options which can all be divided into individual "Rooms" for each separate conversation. It also offers integration with Cisco phones and products and free guest support.

Cisco Spark offers three separate pricing plans, each charging a monthly fee per user. The $9 (£7.35) "Basic" package includes video calling, voice messaging, mobility, business call messaging, 1:1 and 3-party video calling with screen sharing and the chance to join Spark and SIP-based meeting.

A $15 (£12.25) "Standard" service and $30 (£24.50) "Premium" option each add some extra features.

7. Best enterprise collaboration software tools: Salesforce Chatter

Best enterprise collaboration software tools: Salesforce Chatter
Image: Salesforce Chatter

One of the earliest entries in the enterprise collaboration market was Chatter, which Salesforce released in 2010. Chatter offers user profiles and groups and lets you share information, access Salesforce files and post comments as status updates which are displayed on a news feed.

Chatter is free for all Salesforce users, and is also available to non-Salesforce users for $15 (£12.25) per user per month. The price includes the Salesforce content library, the ideas and answers features of Salesforce CRM, read-only access to accounts and contacts, and the Force.com platform.

8. Best enterprise collaboration software tools: Jive

Best enterprise collaboration software tools: Jive
Image: Jive Software

Jive's interactive intranet software provides real-time communication and collaboration though live activity streams, groups, discussions and blogs. Documents can be edited and read in real-time by multiple users and interactions assessed with in-built analytics capabilities.

The level of functionality available depends on which package is purchased. Jive's monthly cost per user is $5 (£4.08) for the "Select" package, $9 (£7.35) for "Premier" and $16 (£13.06) for "Premier+".

9. Best enterprise collaboration software tools: Sharepoint

Best enterprise collaboration software tools: Sharepoint
Image: Microsoft

SharePoint provides a long list of powerful collaboration features that go far beyond enterprise social networking and was recently overhauled by Microsoft to compete with more user-friendly alternatives that prioritise communication.

The customisation and variety of functions available through the Sharepoint document management and storage systems remain its biggest selling point. Sharepoint is available in three different packages, at £3.10, £6.20 or £14.70 for each monthly user.

  • Digg
  • Del.icio.us
  • StumbleUpon
  • Reddit
  • RSS