Archive for the ‘General’ Category

 

Big Data Cloud Servers for Hadoop

Monday, January 13th, 2014 by

GoGrid just launched Raw Disk Cloud Servers, the perfect choice for your Hadoop data node. These purpose-built Cloud Servers run on a redundant 10-Gbps network fabric on the latest Intel Ivy Bridge processors. What sets these servers apart, however, is the massive amount of raw storage in JBOD (Just  a Bunch of Disks) configuration. You can deploy up to 45 x 4 TB SAS disks on 1 Cloud Server.

These servers are designed to serve as Hadoop data nodes, which are typically deployed in a JBOD configuration. This setup maximizes available storage space on the server and also aids in performance. There are roughly 2 cores allocated per spindle, giving these servers additional MapReduce processing power. In addition, these disks aren’t a virtual allocation from a larger device. Each volume is actually a dedicated, physical 4 TB hard drive, so you get the full drive per volume with no initial write penalty.

Hadoop in the cloud

Most Hadoop distributions call for a name node supporting several data nodes. GoGrid offers a variety of SSD Cloud Servers that would be perfect for the Hadoop name node. Because they are also on the same 10-Gbps high-performance fabric as the Raw Disk Cloud Servers, SSD servers provide low latency private connectivity to your data nodes. I recommend using at least the X-Large SSD Cloud Server (16 GB RAM), although you may need a larger server, depending on the size of your Hadoop cluster. Because Hadoop stores metadata in memory, you’ll want more RAM if you have a lot of files to process. You can use any size Raw Disk Cloud Server, but you’ll want to deploy at least 3. Also, each Raw Disk Cloud Server has a different allocation of raw disks, which are illustrated in the table below. The Cloud Server in the illustration is the smallest size that has multiple disks per Cloud Server. Hadoop defaults to a replication factor of three, so to protect your data from failure, you’ll want to have at least 3 data nodes to distribute data. Although Hadoop attempts to replica data to different racks, there’s no guarantee that your Cloud Servers will be on different racks.

Note that the example below is for illustrative purposes only and is not representative of a typical Hadoop cluster; for example, most Cloudera and Hortonworks sizing guides start at 8 nodes. These configurations can differ greatly depending on if you intend to use the cluster for development, production, or production with HBase added. This includes the RAM and disk sizes (less of both for development, most likely more for HBase). Plus, if you’re thinking of using these nodes for production, you should consider adding a second name node.

Hadoop-cluster (more…) «Big Data Cloud Servers for Hadoop»

Geographic Load Balancing and Disaster Recovery Best Practices for Global Websites

Wednesday, August 21st, 2013 by

Technological World

If you’re running a global website, you’ll want to reduce the latency for customers around the world. GoGrid offers the global infrastructure and robust network to support this setup. With Geographic Load Balancing, GoGrid can also improve performance to your website from around the world. Here are recommended best practices for building a reliable, high-performing global website.

Deploying the Correct Infrastructure Setup

Global websites still require local infrastructure to be truly effective in reducing latency. GoGrid has data centers around the world where you can deploy infrastructure to better serve your customers. Deploy infrastructure to the Western United States (in our US-West-1 data center), Eastern United States (in US-East-1) and Europe (EU-West-1). Although your specific configuration is unique to your setup, you’ll most likely have database and webservers in each of these data centers.

In addition, you’ll want to keep your servers in-sync. One option between US-West-1 and US-East-1 is to use Cloud Link, a dedicated, private line between our data centers. This connectivity makes synching your servers secure and easy. Once you have your back end in place, you’ll want to configure your front end.

Geographic Load Balancing

(more…) «Geographic Load Balancing and Disaster Recovery Best Practices for Global Websites»

Building private cloud infrastructure

Friday, July 5th, 2013 by

Although the proliferation of public cloud computing technologies has encouraged a large portion of the business world to migrate resources to an off-site environment, many decision-makers believe managing their own assets can be more beneficial. For this reason, among others, enterprise executives often prefer to leverage a private cloud architecture that enables them to satisfy numerous goals that cannot be met while using only the public cloud.

Building a private cloud infrastructure

Building a private cloud infrastructure

Yet constructing a private cloud is not a simple one-and-done process. A recent InfoWorld report highlighted how constructing a private infrastructure is similar to building a data center, though it is distinct in several ways. For one, the management layer capabilities are different in a private cloud than they are in a premise-based virtualization architecture.

InfoWorld noted that private clouds, for the most part, will offer some level of self-service, which is important for organizations that need to manage various solutions throughout their life cycle. Unlike conventional data centers, however, these management capabilities must be available to business units, not just the IT department. This is because it is often too time-consuming to have business teams consult with IT every time servers must be commissioned or other processes need to happen.

By working with a trusted service provider, companies can be sure they implement private clouds with the appropriate management capabilities for the workforce as a whole.

Leveled security
In traditional IT environments, IT controls the majority of security controls, which makes administrative considerations unnecessary. Because the private cloud enables individuals to decommission, deploy and manage servers on their own, decision-makers need to ensure they have the ability to protect sensitive information and resources during these procedures, InfoWorld noted.

(more…) «Building private cloud infrastructure»

Report: A third of office systems will be in the cloud by 2017

Wednesday, June 26th, 2013 by

Cloud computing is transforming the business world, allowing companies of all sizes to implement advanced software and embrace innovative IT trends with fewer concerns and bigger savings. At the same time, however, not everything that can benefit from the cloud is doing so, as there are many technologies that have yet to make the transition to the hosted environment.

33 percent of office systems will be in the cloud by 2017

33 percent of office systems will be in the cloud by 2017

Unfortunately, the transition of many technologies, such as office systems and email, is slower than many advocates predicted. Gartner recently highlighted this occurrence, noting that only 8 percent of all office system users are in the cloud. Still, analysts believe this is a progressing market, noting that 33 percent of these tools will be in the cloud by 2017.

This market will gain significant momentum after 2015, Gartner noted. This is likely because the cloud will be more familiar to most organizations by then and employees will demand the ability to access mission-critical resources from anywhere.

“Despite the hype surrounding migration to the cloud, big differences in movement rates continue, depending on organizations’ size, industry, geography and specific requirements,” said Tom Austin, vice president and Gartner Fellow. “While 8 percent of business people were using cloud office systems at the start of 2013, we estimate this number will grow to 695 million users by 2022, to represent 60 percent.”

What factors weigh into cloud decisions?
Analysts noted that email is one of the world’s most significant collaborative tools, as it provides individuals with the ability to share information across networks and platforms. In many organizations, the option to move email to the cloud is among the biggest decisions, weighing into moving the entire office system to the cloud or not. Gartner believes that at least 10 percent of all email users will be based in the cloud by the end of next year, a number that will triple by the end of 2017.

(more…) «Report: A third of office systems will be in the cloud by 2017»

Cloud computing improves security for SMBs, studies reveal

Tuesday, June 18th, 2013 by

For the past several years, cloud computing has been disrupting the business world by providing organizations with innovative ways to save money, improve operations and gain access to next-generation applications. Small and medium-sized businesses (SMBs) have begun to recognize that the benefits of the cloud have reached their organizations as well. Still, some fears about the hosted services held many companies back. A recent study of US SMBs by Microsoft, however, revealed that many of these concerns are not backed by data but are really just misconceptions about the technology.

Cloud computing improves security, not impairs it

Cloud computing improves security, not impairs it

The survey found that 60 percent of organizations that have not yet adopted the cloud because of security concerns. Other SMBs that have not embraced the cloud said the fear of unreliability or loss of control over sensitive data held them back.

Conversely, businesses that have adopted the cloud have experienced benefits in all of these categories, suggesting the shroud of uncertainty surrounding the cloud should not be an obstacle.

“There’s a big gap between perception and reality when it comes to the cloud. SMBs that have adopted cloud services found security, privacy and reliability advantages to an extent they didn’t expect,” said Adrienne Hall of Microsoft. “The real silver lining in cloud computing is that it enables companies not only to invest more time and money into growing their business, but to better secure their data and to do so with greater degrees of service reliability as well.”

The truth about the cloud
The underlying reality of a cloud infrastructure is that it is often more secure and reliable than traditional premise-based systems. Microsoft highlighted this truth when it found that a whopping 94 percent of SMBs using the cloud revealed that they acquired more security benefits using the hosted services than they did with legacy solutions. This meant having access to more innovative and up-to-date antivirus and data management tools.

(more…) «Cloud computing improves security for SMBs, studies reveal»