KML_FLASHEMBED_PROCESS_SCRIPT_CALLS

Archive for the ‘Open Source’ Category

 

How To Optimize Your Database Backups and Text File Compression with pbzip2 and pigz

Thursday, February 9th, 2012 by

Recently, GoGrid was examining performance enhancements on several internal processes; among these enhancements was switching from standard gzip to “pigz”. Since I had never heard of this “pigz”, I was intrigued by this supposed “parallel” implementation of gzip; meaning it uses all available CPU’s/cores unlike gzip. This prompted me to ask, “I wonder if there is a parallel implementation of bzip2 as well”, and there began my endeavor.

pigz and pbzip2 are multi-threaded (SMP) implementations of their respective idol file compressors. They are both actively maintained and are fully compatible with all current bzip2 and gzip archives.

If you’re like me, you might’ve stayed away from using gzip or bzip2 due to the single-threaded aspect. If I try to compress a, let’s say, 2GB file, the system becomes rather sluggish; the reason being is that the “compression tool of choice” uses almost all of 1 core of today’s multi-core, multi-CPU systems and creates an uneven load between the cores, causing the CPU to operate very inefficiently.

In this example I have a .tar file with several databases in it, which totals 1.3GB. The system in question is a GoGrid dedicated server with 8 cores. The server’s load is around 1 and is a production database server.

Using bzip2, the file took approximately 6 minutes and 30 seconds to compress. Yikes!

bzip2

(more…) «How To Optimize Your Database Backups and Text File Compression with pbzip2 and pigz»

How to Monitor Your Windows 2008 Server on GoGrid with Cacti 0.8.7g

Tuesday, June 14th, 2011 by

This is the 3rd and final post in my setup and use of the GoGrid Community GSI server for Cacti Monitoring. In my first post, “Set Up A Cacti Monitoring Server in Minutes with this GoGrid Community Server Image,,” I covered how to deploy Cacti in your GoGrid environment using a Community GSI. My second post, “How to Monitor Your Ubuntu Server on GoGrid in 6 Steps Using Cacti 0.8.7g,” I discussed how to initiate monitoring of your GoGrid Ubuntu server. Now to round things off, I want to show you how to link up your Cacti monitoring server to a Windows Server 2008 server on your GoGrid network. The base install of Cacti 0.8.7g will allow you to monitor the server’s bandwidth utilization, Ethernet errors, number of logged in users, and total number of processes. There are other templates available to monitor other components and services on your Windows server, but they require using an additional SNMP service beyond the Microsoft SNMP service. My blog post won’t get into the latter, but I will cover the former.

Objectives:

  1. Configure GoGrid private network connectivity on Windows 2008 Server and test connectivity to Cacti server
  2. Configure and start Microsoft SNMP service on your Windows 2008 Server
  3. Add new Cacti device
  4. Create graphs to log Local Connection and Local Connection 2 bandwidth and errors, Logged in Users, and server processes

Configure GoGrid private network connectivity on Windows 2008 Server and test connectivity to Cacti server

Below we see that we have a server (“Web2”) deployed on GoGrid with a public IP. Let’s log into this server and configure the private network with a private IP from the same subnet of the Cacti Monitor server. As I described in my previous post – I am using the prescribed private IP subnet from my GoGrid portal, contained under the List tab and then under Network – Private Network.

Selection_101

(more…) «How to Monitor Your Windows 2008 Server on GoGrid with Cacti 0.8.7g»

Agile Development at GoGrid with Pallet and Jclouds (Presentation)

Tuesday, February 8th, 2011 by

In order to provide a more “rounded” voice on the GoGrid blog, we are going to start having some new authors. To kick off this initiative, I wanted to introduce Paul Lappas, GoGrid’s VP of Engineering and Co-Founder. Paul manages GoGrid’s engineering efforts, technical operations, IT and the technology vision for GoGrid.

Recently, he and some other team members attending a MeetUp in San Francisco at the Twitter headquarters to discuss and present  JClouds and Pallet and how those tools are being used at GoGrid. Here is Paul’s synopsis of Jclouds and the presentation:

“GoGrid is doing some really cool stuff using an automated provisioning technology called “Pallet”.  Pallet is similar to existing automating configuration technologies like Puppet and Chef but with a key difference that it was built specifically to solve the problem of quickly spinning up and configuring groups of servers in the cloud. It support “Jclouds” out of the box and is implemented as a set of libraries for “Clojure” which is a LISP-based programming language that is quickly building steam.  Jclouds is an open source framework developed by Adrian Cole that helps you get started in the cloud and reuse your java development skills, with an API that allows you the freedom to use portable abstractions or cloud-specific features.

GoGrid is working with the author of Pallet (Hugo Duncan) and a key contributor Toni Batchelli to enable the fast deployment of fully functional GoGrid environments for use by development teams for test & dev. It’s a tough problem for most companies, but especially challenging for us considering how complex (and capital intensive) it is to stage an end-to-end GoGrid environment due to the sheer breadth of technologies that span almost all 7 layers of the OSI stack. With Pallet, we are able to treat our “infrastructure as code” and manage the configuration of systems, networks and applications just like we do our source code so that they can be quickly applied to spin-up new environments. But perhaps the coolest aspect is that we are using GoGrid internally to virtualize the individual components! It’s kind of like Inception where there is a grid-within-a-grid. Our teams are still getting their heads around logging into a GoGrid account and seeing virtual representation of physical GoGrid components represented as VM icons in the GUI! Very cool stuff.

The following presentation provides more details of the implementation and was presented at the recent Jclouds meetup at Twitter’s headquarter in San Francisco. Check out future jclouds meetups here:
http://www.meetup.com/jclouds/

Below is the presentation that was presented at the Jclouds meetup: (more…) «Agile Development at GoGrid with Pallet and Jclouds (Presentation)»

GoGrid Participating in the Deltacloud “One API for Many Clouds” Initiative

Thursday, August 26th, 2010 by

GoGrid has long been supporter of open standards and the open source movement. We recently promoted how many open source solution providers are leveraging GoGrid as a platform to disseminate their open source solutions and technology in the cloud. Long before that at the beginning of 2009, we made our public API available to the public under a Creative Commons Attribution Share Alike License. This meant that under this licensing, developers could “share, distribute, display and perform the work” as well as “make derivative works” based on our API.

Now we are taking it one step further because we realize in order for Cloud Computing to be adopted across the business IT landscape, there needs to be more standards put in place as well as a commonality across the board when it comes to Application Programming Interfaces (APIs). The Deltacloud initiative is grabbing this issue by the horns by working to combine interoperability with an open sourced API. And, they are the only major cloud framework that isn’t leveraging a single company’s proprietary code, API or intellectual property.

deltacloud_image

Deltacloud, an Apache Software Foundation incubator project that provides an open set of application programming interfaces (APIs) to enable computing interoperability across private and public clouds, recently announced support for GoGrid and we are pleased to participate in this important initiative. There are quite a few advantages of this effort, specifically:

  • The API can be offered by a cloud provider or individual user running their own server
  • Multiple client libraries can be written in a variety of computer languages (many are already available)
  • The core API logic resides on the API server, allowing consistent behavior across all client libraries
  • New cloud providers can be added to the API without needing to change the clients

deltacloud_diagram-soa

(more…) «GoGrid Participating in the Deltacloud “One API for Many Clouds” Initiative»

Newsletter: GoGrid Customer Update – August 2010 – New Features/Enhancements, UVP, Partner, CDN, Events & other News

Monday, August 9th, 2010 by

This month, we tried something a bit different with our Customer Newsletter for August 2010 in that we sent the newsletter from our Service Teams. In case you didn’t already know this, every GoGrid customer is assigned a service team to help our customers manage and grow their GoGrid account and answer any questions customers may have. The teams consist of an Account Manager, a Support Specialist, a Billing Specialist, a Data Center Technician and a Network Specialist.

GoGrid_Service_Team

Even though it is the summer here, we are hard at work growing the GoGrid product and feature offering as we strive to live up to our new Unique Value Proposition: “Complex Infrastructure Made Easy™”.

GG_august_2010_newsletter

Below is the full content of the August 2010 Customer Update newsletter that went out to all GoGrid customers:

Hello,

(more…) «Newsletter: GoGrid Customer Update – August 2010 – New Features/Enhancements, UVP, Partner, CDN, Events & other News»