You are browsing the archive for 2012 December.

System Center 2012 SP1 is RTM! How do I upgrade my SCOM environment?

1:39 pm in #scom, sysctr by Jan Van Meirvenne

Hey all!

I am pleased to announce that System Center 2012 SP1 has reached RTM and is now available for Technet and MSDN Subscribers!

I downloaded the binaries for SCOM and here I provide a quick list of steps on how to upgrade your RTM-version of SCOM 2012 to SP1.

First, make a good read of the release notes, so you know what issues or extra after-installation steps are present.

  • First, take a backup of your SCOM-databases. If the upgrade goes wrong your database is toast in most cases, and a restore is inevitable.
  • Okay, get the SP1 binaries on your first management server and launch setup.exe, a splash-screen appears:
    image
  • Okay, the most obvious option is the one we want :‘Install’! We are greeted by an overview of the upgrade wizard-steps (because it detects an RTM installation of SCOM 2012) and an extra warning that we should backup our databases.
    image
  • The next screen is the usual licensing text. After reading it through (all of it of course), lets continue!
    image
  • Just plain and simple, where do you want to install the new binaries? Take a pick and go!
    image
  • Ah, the both dreaded and loved prerequisite scan! And what’s this, we are missing something! This means a prerequisite was added for the service pack. We need the HTTP Activation feature, a sub feature of the .NET Framework 3.5.1 role. (Might be different or not needed on Server 2012)
    image
  • No problem, we just install the prerequisiteimage
  • Lets recheck. Much better!image
  • Next step, providing the SDK service account. I filled in the same one that was used for the RTM-installation.image
  • A summary? Are we done already? Wow, no effort at all (almost). Get ready, set, go & upgrade!
    image image
    image
    And it actually did take this long…
    image
  • But what about my second management server?
    image
    image
    Oh oh…!
    image
    That looks nasty! Lets upgrade the second management server asap!
    image
    You know how the rest goes :)
  • After the 2nd upgrade: much better!
    image
  • Now, the only thing left to do is upgrade the agents.
    image

And that’s it, you’re done!

TAKEAWAYS

  • Do not forget to go through the release notes
  • New prerequisite (on 2008 R2): HTTP Activation (under .NET Framework 3.5.1)
  • Non-upgraded management servers cannot communicate with an upgraded management group
  • Overall, the upgrade is straightforward and foolproof

This was my last blogpost for this year. Happy holidays and see you later!

Troubleshooting: Can not attach new agents to a management group

1:29 pm in #scom, sysctr by Jan Van Meirvenne

Some time ago I was asked for help by a fellow engineer who was troubleshooting a rather spicy SCOM-issue:

He had removed some agents from the management group because their server was reimaged to another OS. Afterwards he wanted to re-approve the agents, but instead of accepting the agents the RMS refused to let them connect. Even waiting for an entire night and only then approving the agents did not resolve the issue. After some time, the agents could neither be approved or declined, because the pending actions didn’t show up anymore. The RMS produced a lot of sickening events:

  • Event 20000: A device which is not part of this management group has attempted to access this Health Service.
  • Event 21042: Operations Manager has discarded X items in management group xxxxx, which came from xxxx. These items have been discarded because no valid route exists at this time. This can happen when new devices are added to the topology but the complete topology has not been distributed yet. The discarded items will be regenerated.
  • Many more distressing events

I performed the standard diagnostics and recovery attempts (flushing the agent cache, denying the agents and then approve them,…) but to no avail. This is where I thought to myself  ‘Lets backup the databases and go dirty’. In the end this where the steps that helped:

(BTW: This is NOT a supported procedure, so make a backup before touching anything!)

  • Stop all RMS services (Data Access, Configuration and Management)
      • Delete the health service state folder
      • Start all 3 services back up

These first steps did a lot to ‘unclog’ the RMS. The bad to good event ratio became a lot more balanced. This led me to believe that the RMS’ cache had become corrupt, and needed some cleaning to get all things running again.

However, did didn’t automagically fix the issue with adding agents. So I started doing some database actions:

  • Delete any traces of the problematic agents
USE [OperationsManager]
UPDATE dbo.[BaseManagedEntity]
SET
[IsManaged] = 0,
[IsDeleted] = 1,
[LastModified] = getutcdate()
WHERE FullName like ‘%computername%’
  • Groom out the marked-for-removal items
DECLARE @GroomingThresholdUTC datetime

SET @GroomingThresholdUTC = DATEADD(d,-2,GETUTCDATE())

UPDATE BaseManagedEntity

SET LastModified = @GroomingThresholdUTC

WHERE [IsDeleted] = 1

UPDATE Relationship

SET LastModified = @GroomingThresholdUTC

WHERE [IsDeleted] = 1

UPDATE TypedManagedEntity

SET LastModified = @GroomingThresholdUTC

WHERE [IsDeleted] = 1

EXEC p_DataPurging

  • Remove hidden pending actions
exec p_AgentPendingActionDeleteByAgentName ‘agentname.domain.com’

Okay, now everything related to our problematic agents was flushed from the database. And as I expected: another restart of the agents and some approvals later, the communication with the RMS was flawless and error free.

Although I have not an exact idea about how the database and/or RMS could get so confused, I suspect that at some point in time corruption introduced a series of sync-issues between the RMS and database.

Introduction

11:38 am in Uncategorized by Jan Van Meirvenne

Hi

My name is Jan Van Meirvenne and I am a System Center consultant employed by Ferranti Computer Systems.
My main focus area is Operations Manager, but I also touch Orchestrator and Configuration Manager from time to time.

With this blog I hope to share my experiences, knowledge and insights regarding my work with the community.

I already have a blog here, and I will keep posting there aswell as here.

I hope you learn something new everyday you ready any SCUG blogpost, happy reading!