Press "Enter" to skip to content

Category: Cloud

Using EC2 Spot Instances with ECS

Had the opportunity to write an article for AWS Startups Blog, explaining how we use EC2 Spot Instances with ECS at Signal: “Every day, Signal ingests millions of documents from a growing number of publishers, including online media, print newspapers, broadcast, regulation and legislation. Our text analytics pipeline processes these documents in real time, applying our own AI algorithms and machine learning, preparing them to be searched from our application and distributed via our alerts system. The entire Signal platform is built on a large number of microservices running on Docker containers deployed to Amazon ECS. In fact, we run almost all of our workloads on top of several ECS clusters including ingestion, processing and consumption. With the hyper growth of our platform we have started to face several challenges, primarily on efficiency and capacity planning. We had a lot more questions than answers. What is the best way to…

Leave a Comment

OpenDedup Virtual Appliance (based on SDFS)

OpenDedup just released a greatly enhanced Virtual Appliance based on SDFS. The OpenDedup Virtual NAS Appliance is designed for simple setup and management SDFS volumes for virtual environments. The Appliance includes capabilities to create, mount,delete, and export SDFS volumes via NFS from a Web Based interface. It also includes VMWare storage api integration that allow the quick Data Store creation and cloning of Virtual machines located on SDFS Volumes. Interesting. Video.

Leave a Comment

Online backups and broadband upload limits

I have a MacBook laptop that I want to backup. What should I do? Normally, I will buy a decent disk (500G or 1T SATA are very affordable these days) and I will normally use something like TimeMachine. Happy, joy. Now, I want more. What if I don’t want to spend more money with a second drive, deal with RAID and choose a storage service “in the cloud” for backing up the backup? What if want to access some files from everywhere? There is Amazon S3 (cheap, copy&forget). There is a lot of services and there is Mozy ($4.95 for unlimited storage). Hmm, I have unmetered ADSL @ home. So I’ve signed up and there we go, started the backup. Of course, my ADSL has 512K of upstream limit. Slow has hell. But I only want 12G “in the cloud”. I’ve waited and it took me more than 1 week…

1 Comment