mongodb

Unraveling the Extract, Transform, Load (ETL) Data Migration Process: A Deep Dive on Load

janez — Wed, 24 Jan 2024 13:37:01 +0000

In this episode of Tag1 Team Talks, our team of Drupal experts delve into the essential "Load" phase of the ETL (Extract, Transform, Load) process in Drupal migrations.

janez Wed, 01/24/2024 - 05:37

MongoDB Cacti Graphs

nnewton — Thu, 01 Apr 2010 04:47:39 +0000

Continuing with our MongoDB monitoring series, today we are releasing Cacti Performance Graphing templates and unit tested data sources for MongoDB. These are built on top of Baron Schwartz's excellent Cacti Graph framework found here ( http://code.google.com/p/mysql-cacti-templates ). This framework allows you to define graphs via a simple (relatively) perl file and to create testable data sources for your graphs. I highly recommend it. MongoDB Cacti These Cacti Graphs, Data Templates and Data Sources allow Cacti to ssh into a remote MongoDB server and create historical graphs from the output of the serverStatus admin command. Using this data, we can graph: Background Flushes Index Operations Commands Connections Memory Usage Slave Lag Some example screenshots can be seen below: Getting The Graphs These graphs have been submitted upstream to the MySQL Cacti Templates Project ( http://code.google.com/p/mysql-cacti-templates/ ). If they are included, they will be available from that project and I will cease maintaining them here. For now, they are available from our internal git repository. Web: http://tag1consulting.com/cgi-bin/gitweb.cgi?p=cacti-mongo.git;a=summary Git: git://tag1consulting.com/cacti-mongo.git The entire framework from the mysql-cacti-templates project is included here. To create the graphs, run make.sh. You can then follow the documentation included or just copy the ss_get_by_ssh script to your scripts...

nnewton Wed, 03/31/2010 - 21:47

MongoDB Nagios Check

nnewton — Tue, 30 Mar 2010 00:48:28 +0000

There has been a lot of talk about No-SQL databases recently, especially in the Drupal community. One of the most popular being MongoDB, due to its easy interface, feature-full design and speed. Use of MongoDB and No-SQL in general is only going to increase in the coming months. At Tag1, we have been working on a few projects with MongoDB as a central infrastructure component. Due to this, we have come upon one of Mongo's problems, youth and because of youth a lack of good tools around it. Monitoring in particular is a complete vacuum. Over the next few weeks we will be releasing the first round of tools we have developed to monitor and test MongoDB, the first being a Nagios Plugin called check_mongo. check_mongo check_mongo is an extremely simple nagios plugin, based on Python and PyMongo. It uses the ServerStatus MongoDB admin command, parsing the results to check for ability to connect, a long query running (query taking longer than X seconds), query count and slave lag. NOTE: The plugin currently requires version 1.4+ of MongoDB. Installation Notes Installation is similar to any other Nagios plugin, you define command sections in nagios for the various actions the plugin...

nnewton Mon, 03/29/2010 - 17:48