Content Staging with Apache Solr

We all love test and staging environments but it becomes a problem when you have Solr integrated in your project and you have a test solr, a staging solr and a production solr core. To re-index a site is not a big problem, but what if you want to go live and switch indexes immediately?

Drupal.org has wrestled with this problem. So I wanted to show you how they do it.

Create three Solr cores - mysite_core1 (will be used for tests) - mysite_core2 (will be used for staging initially) - mysite_core3 (will be used for production initially)

Make sure your staging site indexes as if it was the production site. There are a number of tricks you can apply.

Site hash

Make sure both site hashes are exactly the same, otherwise it won't correctly find the indexed content

  1. variable_set('apachesolr_site_hash', 'mysite_custom_hash');

Base URL

When Solr indexes content, it will use absolute urls. To trick solr you could set the base url to reflect production.

  1. # $base_url = 'http://www.example.com';  // NO trailing slash!

Alter the documents that are being sent

You could also not do the base_url approach and hardcode the fields you want to change. Using the hook_apachesolr_index_documents_alter() you could any of the staging urls to reflect production urls. csevb10 created something similar but used a different hook. Below is more or less the same code, using the documents_alter hook.

  1. function hook_apachesolr_index_documents_alter($documents, $entity, $entity_type, $env_id) {
  2.   $start_url = variable_get('apachesolr_url_switch_start_url', 'http://staging');
  3.   $end_url = variable_get('apachesolr_url_switch_end_url', 'http://production');
  4.  
  5.   $elems = array(
  6.     'site',
  7.     'url',
  8.     'content',
  9.     'teaser',
  10.   );
  11.   foreach ($documents as $id => $document) {
  12.     foreach ($elems as $elem) {
  13.       $documents[$id]->{$elem} = str_replace($start_url, $end_url, $document->{$elem});
  14.     }
  15. }

Create an update function and let it set the correct index position

  1. function my_module_update_7001() {
  2.   // I am assuming your environment is called "core"
  3.   // mark all content to be reindexed so our table would be in sync with the transfered nodes.
  4.   apachesolr_index_node_solr_reindex('core');
  5.   // fetch your current apachesolr_index_last from staging
  6.   $staging_index_last = array();
  7.   variable_set('apachesolr_index_last',$staging_index_last);
  8.   // fetch your current apachesolr_index_updated from staging
  9.   $staging_updated = array();
  10.   variable_set('apachesolr_index_updated', $staging_updated);
  11. }

Switching the core

Once you move to production, make sure you switch the cores. So mysite_core2 becomes production and mysite_core3 becomes staging. You could also copy the complete data dir from solr to your thrid core but that might not be automatic enough for some you.

Enjoy

Nick
Wednesday, November 7, 2012 - 12:37

Comments

On , Most excellent way to choose the best online essay writing s said...

Writing works is great challenging task to students of all academic level. Students are highly afire for about the scam writing service and confused with how to choose the original essay service. To avoid these confusions has a solution is asking your friends with suggestion refer the customer reviews and reviews of related organizations. Obviously, it is easy about the students to find an essay organization of online now days. Many customers prefer the best online essay writing services they can save your time and efforts, they should not allow feeling boring of writing to student and not allow to wasting the best years of your life. Academic task is very common assignments to students it gives shaping the students for reach fine grades. But it is not easy about students, they should have more knowledge for submit the high quality essay in order to be to get a first grades. So this online service is helps to students to get top grades in their academy. Now students don't spend their time for finding the original essay writing corporation. They are here for to solve the all issues of students. They have more than year experience in these fields. This association has plenty of experience of knowledge to write an essay on superior quality. This service can easy your tension between their service which including professional academic writers. This coalition organizing a paper in any discipline with quality and on time.

On , Jeremy McKivat said...

<a href="http://www.urlopener.com/homepage.html">Google</a>

On , Armand said...

Hello everyone, it's my first visit at this website, and piece of writing is really fruitful in favor of me, keep up posting these articles or reviews.

my webpage - essays services - https://www.rushanessay.com/

On , Armand said...

Hello everyone, it's my first visit at this website,
and piece of writing is really fruitful in favor of me, keep up posting these articles
or reviews.

My website essays services - https://www.rushanessay.com/

On , Robby said...

What a stuff of un-ambiguity and preserveness of valuable familiarity about
unpredicted emotions.

Also visit my blog <a href="https://www.customessay-writing.org/term-paper/">admission services</a>

On , Vonnie said...

Social networking sittes like Facebook has generated a large invest the net market.
This is a thing that social media marketing can simply
afford a smaller business. Business people employ this
space to promoting their products annd services.

my web page - <a href="http://1800customerservicenumbers.com">Customer Service Numbers</a>

On , Gilda said...

It's actually a great and useful piece of info.
I'm happy that you shared this helpful information with us.
Please keep us informed like this. Thanks for sharing.

My homepage; <a href="https://www.customessay-writing.org/thesis/">thesis writing</a>

On , Myles said...

I read this post fully concerning the resemblance of most up-to-date
and previous technologies, it's awesome article.

Feel free to visit my website :: <a href="https://www.rushanessay.com/research-paper/">help writing papers</a>

Add new comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Lines and paragraphs break automatically.
CAPTCHA
We all hate spam! Please do me a favor and verify if you are human.