Trouble adding routes

Document created by cdnadmin on Jan 25, 2014
Version 1Show Document
  • View in full screen mode
This document was generated from CDN thread

Created by: Brett Kugler on 22-10-2013 02:41:16 PM
For the past month or so, I've had success with adding routes to the application route table, but in the past week, it has stopped working.  I've tried both the example tutorials as well as my custom application and both are failing, where they both used to work.  I've exhausted all the trouble shooting steps I can think of.

From the C tutorial RoutingTutorial:
Error in updating scope: 1, operation failed: Failed to initiate session with ART
Error while destroying route : 1, operation failed

Trace shows:
[10/22/13 14:19:57.27 2E2] [60] : UpdateRoute: Registering Routing Tutorial:2000 with art [onep_al_l3_ucast_update_app_route:2257]
[10/22/13 14:19:57.27 2E3] [60] : App route table init, app name Routing Tutorial:2000 [onep_al_app_route_table_init:1398]
[10/22/13 14:19:57.27 2E4] [60] : UpdateRoute: Failed to initiate app route table init [onep_al_l3_ucast_update_app_route:2262]

The Java SDK is throwing the following:
 1Stacktrace follows:Message: null
 2    Line | Method
 3->> 3803 | read                                   in
 4com.cisco.onep.idl.RoutingIDL$Routing_L3UcastARTUpdateRoutesIDL_result
 5- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
 6|    259 | recv_Routing_L3UcastARTUpdateRoutesIDL in com.cisco.onep.idl.RoutingIDL$Client
 7|    232 | Routing_L3UcastARTUpdateRoutesIDL . .  in     ''
 8|    188 | updateRoutes                           in com.cisco.onep.routing.AppRouteTable
 9|    369 | addRoute . . . . . . . . . . . . . . . in com.cisco.onep.BaseTutorial
10|     43 | save                                   in onepkinterface.AppRouteController
11|    195 | doFilter . . . . . . . . . . . . . . . in grails.plugin.cache.web.filter.PageFragmentCachingFilter
12|     63 | doFilter                               in grails.plugin.cache.web.filter.AbstractFilter
13|   1145 | runWorker . . . . . . . . . . . . . .  in java.util.concurrent.ThreadPoolExecutor
14|    615 | run                                    in java.util.concurrent.ThreadPoolExecutor$Worker
15^    724 | run . . . . . . . . . . . . . . . . .  in java.lang.Thread
| Error 2013-10-22 14:27:49,019 [http-bio-8080-exec-6] ERROR errors.GrailsExceptionResolver  - ExceptionIDL occurred when processing request:  /OnePKInterface/appRoute/save

Note that an ExceptionIDL is being thrown - and while there is an IDL class in the SDK, there is no documentation detailing on how to handle it.

I feel like I'm missing something fundamental, but I don't have exclusive access over the 2911 that I'm testing against, so it's possible someone else changed something in the router config, but again, I've exhausted what options I could think of.

Any help is appreciated.

Subject: RE: Trouble adding routes
Replied by: Joseph Clarke on 22-10-2013 05:46:56 PM
What version of code is the 2911 running?  What version of the API are you using?  Are you able to provide any show command or debugging output from the 2911?  If so, getting the output of "debug onep routing" would be helpful.

Subject: RE: Trouble adding routes
Replied by: Brett Kugler on 23-10-2013 10:36:43 AM
Joseph Clarke:
What version of code is the 2911 running?  What version of the API are you using?  Are you able to provide any show command or debugging output from the 2911?  If so, getting the output of "debug onep routing" would be helpful.

The 2911 is running 15.3(3)M and I'm using v.1.0 of the SDK.  I've attched the debug output and the stdout from running the RoutingTutorial sample.  I built it using the 64-bit C libraries.

Subject: RE: Trouble adding routes
Replied by: Joseph Clarke on 23-10-2013 11:20:25 PM
This may be a memory issue.  Can you als enable "debug application detail", reproduce the problem, and send the output?

Subject: RE: Trouble adding routes
Replied by: Brett Kugler on 04-11-2013 11:24:56 AM
Sorry, I have been out of the office for the past week.  However, we did figure out what was causing the issue.  The OSPF routing process was given a faulty redistribute command which seems to have been interfering with onePK being able to create it's application routing table.  Once we fixed the redistribute command, I was once again able to add routes via my application.

The only way we figured this out is by going to the engineer who implemented the redistribute as a "what's changed" troubleshooting step.  It's a case of too many cooks in the kitchen, but the solution was highly non-obvious - just something to keep in  mind.

Thanks for the continued support Joseph.

Subject: RE: Trouble adding routes
Replied by: Brett Kugler on 04-11-2013 03:08:40 PM
Joseph Clarke:
Any chance you can share the exact config done so we can look at it in the lab?  This might be a bug we should fix.
Run-conf attached.  Key area to look for:
1router ospf 2 vrf VRF-A
2 router-id 10.249.251.1
3 redistribute application NotMyonePK subnets route-map AppNetworks
NotMyonePK is not the name of my application, if I change the redistribute to:
1 redistribute application GDTonePK subnets route-map AppNetworks
which is my actual app name, I'm able to add routes again.  It's important to note that the app can no longer add routes period, regardless of VRF - in this case we have default, VRF-A and VRF-B and even though we only have the redistribute application under VRF-A, all VRF's are blocked.

Subject: RE: Trouble adding routes
Replied by: Joseph Clarke on 04-11-2013 02:18:44 PM
Any chance you can share the exact config done so we can look at it in the lab?  This might be a bug we should fix.

Attachments

Outcomes