You are browsing the archive for SCDPM2007.

System Center Data Protection Manager 2007 SP1: Errors

8:36 pm in Uncategorized by mikeresseler

Hey All,

Last week I had a strange error with a customer.  Here’s the situation:

One primary DPM server with quite a lot of Protection groups and protected servers that handled the disk to disk backup.  A secondary DPM server that did the backup to tape and of course the backup off the first DPM server.

All backups on the first DPM server went most of the times without any problem, and if there was a problem it could be solved with a consistency check or a rerun of the failed job.

However, everything on the second server failed completely. 

After investigation, I’ve noticed that many times the DPMRA service crashed on the primary server each time the backup server was doing a backup of the first.

I’ve read log files, event viewers but every error described on newsgroups and blog posts were about DPM servers that didn’t had the latest hotfix rollup.  This server and the secondary server however had all the hotfixes installed till date.

So because I couldn’t figure it out, I decided to log a call together with the customer.  Because I am not often with that customer I let him handle it but requested to forward me the steps taken by Microsoft support and hopefully the solution. 

After one week, they found the solution together with the Microsoft engineer.

Just as extra information, here is the error they got on the secondary server

Error Messages: The protection agent on primaryserver.FQDN was temporarily unable to respond because it was in an unexpected state. (ID 60 Details: Internal error code: 0x809909B0) followed by DPM failed to communicate with the protection agent on primaryserver.FQDN because the agent is not responding. (ID 43 Details: Internal error code: 0x8099090E)

So here are the steps taken and the solution.

1) They needed to run an MPS report as described on

http://www.microsoft.com/downloads/details.aspx?FamilyID=CEBF3C7C-7CA5-408F-88B7-F9C79B7306C0&displaylang=en

2) They needed to run the following command (run as administrator!)

MOUNTVOL >c:\mountvol.txt

The engineers from Microsoft quickly viewed the problem

As you can see in the following exctraction out of the mountvol.txt file

\\?\Volume{8639bea9-80c6-11de-a621-0015179ff253}\

        Q:\Program Files\Microsoft DPM\DPM\Volumes\Replica\servername\MSDEWriter\naamdatabase

        D:\Program Files\Microsoft DPM\DPM\Volumes\Replica\servername\MSDEWriter\naamdatabase

\\?\Volume{32c0e517-64c6-11de-9f82-0015179ff253}\

Q:\Program Files\Microsoft DPM\DPM\Volumes\Replica\Servername\Non VSS Datasource Writer\Computer\SystemState\SystemState\

        D:\Program Files\Microsoft DPM\DPM\Volumes\Replica\Servername\Non VSS Datasource Writer\Computer\SystemState\SystemState\

\\?\Volume{1ea729a2-7c50-11de-bff1-0015179ff253}\

        Q:\Program Files\Microsoft DPM\DPM\Volumes\DiffArea\Servername\File System\D-2a56f4ae-783c-11de-8b69-005056ac1ad1\

        D:\Program Files\Microsoft DPM\DPM\Volumes\DiffArea\Servername\File System\D-2a56f4ae-783c-11de-8b69-005056ac1ad1\

The whole file was full with duplicate paths to the same volume, although this was not seen in a normal explorer

This happened because they once changed the location of the volumes.

Now the customer can use the mountvol command (with /d to remove the duplicates one by one, or take the the old disk offline and use the /R for all in once) to clear out the duplicate paths.

That solved the case

Cheers,

Mike

System Center Data Protection Manager 2007 SP1: Bare Metal Recovery of Windows Server 2008

8:54 am in Uncategorized by mikeresseler

Hey All,

Microsoft has updated its whitepaper Bare Metal Recovery of Windows Server 2008 with System Center Data Protection Manager 2007 SP1

It can be found at http://download.microsoft.com/download/2/A/B/2AB50D28-D892-4BF3-B823-C62CA02E4CF8/DPM%202007%20SP1%20Bare%20Metal%20Recovery%20of%20Windows%20Server%202008.doc

Important to know is that the DPM SRT (System Recovery Tool) that is used for recovering windows 2003 and windows XP has been completely replaced by the built-in backup utility of Windows server 2008, the WSB (Windows Server Backup) utility.

In the white-paper, they give a step-by-step instruction on how to enable bare metal recovery of a windows server 2008

Except for the fact that you need to do some additional work, this procedure certainly has some possibilities for the BMR of a physical windows server 2008. 

Still, I believe more in the procedure of working with the offline P2V which was discussed two weeks ago.  Since Matthijs Vreeken has responded on my questions I’m gonna keep working on this procedure and test it out.

Cheers,

Mike

System Center Data Protection Manager 2007 SP1: Sharepoint issues

9:28 am in Uncategorized by mikeresseler

Hey All,

One of our engineers was having a big issue with the protection of a sharepoint farm.  In DPM, he could not resolve the following error:

The replica of SSPComponent_SSP Intranet on servername is inconsistent with the protected data source. All protection activities for data source will fail until the replica is synchronized with consistency check.

He has searched a lot on the problem but finally found that the problem was not with the DPM program but with the Sharepoint configuration.

The problem was that some service accounts tried to do a remote log-on to the server.  These service accounts are used for the timer / search server functions and had the appropriate rights locally but did not had the rights to do this remotely.

After adding the service account the rights to “logon as a batch” and “logon as a service” it suddenly started to work again.

Cheers,

Mike

System Center Data Protection Manager 2007: Tape problems

5:10 pm in Uncategorized by mikeresseler

Hey All,

During one of the implementations of DPM, one of my colleagues got into problems with the recognition of a tape library.  Although the tape library worked during the staging phase, when it got into production, it stopped working.  There were 20 tapes in the library, but DPM didn’t recognize them, and after you ran a fast recovery, you got the following error:

 

Connection to the DPM service has been lost.

DPM service could be running in recovery mode, which was initiated by the DpmSync tool. If DpmSync is not running and the DPM service is still in recovery mode, then run DpmSync again.

 

After having multiple steps with the Microsoft support team, they finally found a solution.  Because I thought the process of troubleshooting was interesting, I thought I posted it here.

1) Try the obvious

– Make sure that you have run the DPMDriveMappingTool.exe

2) If you want to log a call with MS Support:

– Run a DPM MPS report, the tool can be downloaded @ http://www.microsoft.com/downloads/details.aspx?FamilyID=14392186-6707-45a5-8987-29665abbd6f5&displaylang=en

 

Out of the reports that we have sent to them, they saw that “More than one mediapool reported for same media”.

Apparently, this can happen each time the DPM database has incorrect information about the tape drives, which can be caused when OEM drivers are updated when the vendorID’s and productID’s change.

Now to solve this one, you need to run a query that will reset the tables.  They gave us two procedures for that, depending on whether the tape library is shared or not.

Here they are:

 

PROCEDURE-1) STANDALONE (non-shared) TAPE LIBRARY CONFIGURATION REPAIR STEPS
===============================================================================
1) Close DPM UI
2) Backup the DPMDB by running dpmbackup -db from command prompt.
3) Open sql server management studio in context of DPMDB database instance. Make
sure you are admin on the machine
4) Select DPMDB. Right click -> New Query
5) Open the Query.txt file and copy paste its content in the query window
6) Execute the query.
7) Make sure query has succeeded.
8) Close SQL management studio
9) Open DPM UI
10) Go to library management tab
11) Do rescan
12) Let this rescan succeed. This rescan will detect libraries and will run Fast
inventory on the library.

PROCEDURE-2) SHARED LIBRARY CONFIGURATION REPAIR STEPS
===========================================================
(step i) On Library DPM server :
1) Close DPM UI
2) Backup the DPMDB by running dpmbackup -db from command prompt.
3) Open sql server management studio in context of DPMDB database instance. Make
sure you are admin on the machine
4) Select DPMDB. Right click -> New Query
5) Open the Query.txt file and copy paste its content in the query window
6) Execute the query.
7) Make sure query has succeeded.
8) Close SQL management studio
(step ii) On Client DPM server :
1) Close DPMUI
2) Backup the DPMDB by running dpmbackup -db from command prompt.
3) Open sql server management studio in context of DPMDB database instance. Make
sure you are admin on the machine
4) Select DPMDB. Right click -> New Query
5) Open Query.txt file and copy paste its content in the query window
6) Execute the query.
7) Make sure query has succeeded.
8) Close SQL management studio
9) Now run SetSharedDPMDatabase tool with parameter as the library server instance
name (if this does not succeed then reboot the machine and again retry running the
tool)
IE: SetSharedDPMdatabase -Instancename
<dpmservername-hosting-Global-SQL-Server>\MS$DPM2007$
(step iii) on Library DPM server
1) Open DPM UI and then on Client DPM Server.
2) Go to library management tab
3) Do rescan
4) Let this rescan succeed. This rescan will detect libraries and will run Fast
inventory on the library. Let this finish before going to next step
(step iv) on Client DPM server
1) Open DPM UI and then on Client DPM Server.
2) Go to library management tab
3) Do rescan

 

And finally, of course, you need the query.  Because it is way too long to upload the text here, I’ll ask the site owners to upload the query to the media library on scug.be

// Update, just found out that you can attach something to a post.  So here it is… query.txt :-)

Cheers,

Mike

System Center Data Protection Manager 2007: Knowledgebase article for the new hotfix package is now available

4:17 pm in Uncategorized by mikeresseler

http://support.microsoft.com/default.aspx?scid=kb;EN-US;976542

Cheers,

Mike

System Center Data Protection Manager 2007: Recatalog an expired tape

4:14 pm in Uncategorized by mikeresseler

Hey All,

Ever needed to get data from a tape that is already expired?  In DPM, you won’t have the option anymore to recatalog the tape when it is expired.

Santhosh Sivarajan from Houston has found a simple workaround:

* Select the tape and mark the tape as free

* Select the tape again and unmark the tape as free

* Now you can choose Recatalog imported tape

The original post can be found here:

http://blogcastrepository.com/blogs/santhosh/archive/2009/10/29/recatalog-an-expired-tape.aspx

Cheers,

Mike

System Center Data Protection 2010: New cloud offering?

12:43 pm in Uncategorized by mikeresseler

Hey All,

Microsoft is really pushing the car for could offerings.  It has recently announced that it has established a partnership with i365, the software company of Seagate, to provide could-based data protection for DPM 2010. 

 

The offering would integrate i365’s EVault data protection software and cloud-connected storage infrastructure with DPM 2010.

The announcement can be found here:

http://www.i365.com/assets/downloads/press/pr_2009_11_9.html

More information is found here:

http://www.i365.com/solutions/microsoft/index.html

Cheers,

Mike

System Center Data Protection Manager 2007: New hotfix package

11:50 am in Uncategorized by mikeresseler

Dear All,

A new hotfix package has been released by Microsoft for DPM 2007.  It can be downloaded @

http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=74ac7461-dbfe-4bc1-85a2-4d2948f30e42

The knowledgebase article is not yet available for the moment but I guess it will arrive soon :-)

Cheers,

Mike

System Center Data Protection Manager 2007: Errors by example…

5:37 pm in Uncategorized by mikeresseler

Hey All,

Recently I had to troubleshoot a DPM installation that suddenly didn’t work anymore.  After investigation (and having a lot of troubles finding something) I’ve noticed the following errors in the event viewer.

image

So I started to check everything on SQL level and discovered that the DPM jobs were running as a domain user (a so called service account with log on rights…)

So I looked at Services and discovered that the DPM instance and the SQL Agent for that instance were running under that service account.

After changing it back to the local user MICROSOFT$DPM$ACCT and restarting the server, everything worked back as a charm.

Hope it helps,

Cheers,

Mike

System Data Protection Manager 2007: Errors by example…

2:37 pm in Uncategorized by mikeresseler

Hey All,

Today I’ve got this notification on a fully patched SCDPM 2007

image

So, when I read the information in the box, I decided to refresh the tape library.  This however crashed the DPM console with the following information:

Connection to the DPM service has been lost.
DPM service could be running in recovery mode, which was initiated by the DpmSync tool. If DpmSync is not running and the DPM service is still in recovery mode, then run DpmSync again.
Review the application event log for information about a possible service shutdown. Verify that the following services are not disabled:
DPM
DPM Replication Agent
SQLAgent$MS$DPM2007$
MSSQL$MS$DPM2007$
Virtual Disk Service
Volume Shadow Copy

So I decided to run a DPMSync Tool and these were the results:

image

So I reopened the console and started the sync again, and now it worked like a charm.

Hope it helps,

Cheers,

Mike