Details Ticket 3168


Comment | Reply | Take | Open


Serial Number 3168
Subject r.to.vect - broken pipe
Area grass6
Queue grass
Requestors tutey@o2.pl
Owner none
Status resolved
Last User Contact Wed Apr 25 20:52:50 2007 (1 yr ago)
Current Priority 30
Final Priority 70
Due No date assigned
Last Action Wed Apr 25 20:52:50 2007 (1 yr ago)
Created Wed Apr 20 10:05:53 2005 (3 yr ago)

Transaction History Ticket 3168


Wed, Apr 20 2005 10:05:53    Request created by guest  
Subject: r.to.vect - broken pipe

Platform: GNU/Linux/i386
grass obtained from: Trento Italy site
grass binary for platform: Compiled from Sources
GRASS Version: grass61_13_04_05_1052

Hi

When I was converting a raster consisted of two patched SRTM 3" lat-long tiles
into vector points, a "Broken pipe" occured and the resulting vector layer has
no topology.

With single SRTM 3" all is ok. Are two such rasters to big to be handled correctly
indeed?

GRASS 6.1.cvs (wgs84):~ > r.to.vect input=srtm_odra_patched output=srtm_odra_patched_pkt
feature=point
 100%
Building topology ...
2881223 primitives registered
Building areas:  100%
0 areas built
0 isles built
Attaching islands:
Attaching centroids:  100%
Topology was built.
Number of nodes     :   2881223
Number of primitives:   2881223
Number of points    :   2881223
Number of lines     :   0
Number of boundaries:   0
Number of centroids :   0
Number of areas     :   0
Number of isles     :   0
Broken pipe

GRASS 6.1.cvs (wgs84):~ > v.info srtm_odra_patched_pkt
ERROR: Cannot open old vector srtm_odra_patched_pkt@srtm_odra on level 2

the input raster:
GRASS 6.1.cvs (wgs84):~ > r.info srtm_odra_patched
 +----------------------------------------------------------------------------+
| Layer:    srtm_odra_patched              Date: Tue Apr 19 16:51:00 2005   
|
 | Mapset:   srtm_odra                      Login of Creator: trawiarz      
|
 | Location: wgs84                                                          
|
 | DataBase: /home/grassdata                                                
|
 | Title:     ( srtm_odra_patched )                                         
|
 |----------------------------------------------------------------------------|
|                                                                           
|
 |   Type of Map:  raster              Number of Categories: 494            
|
 |   Data Type:    CELL                                                     
|
 |   Rows:         1201                                                     
|
 |   Columns:      2401                                                     
|
 |   Total Cells:  2883601                                                  
|
 |        Projection: Latitude-Longitude (zone 0)                           
|
 |            N: 52:00:01.5N    S: 50:59:58.5N   Res: 0:00:03               
|
 |            E: 17:00:01.5E    W: 14:59:58.5E   Res: 0:00:03               
|
 |   Range of data:    min =  37 max = 494                                  
|
 |                                                                          
|
 |   Data Source:                                                           
|
 |                                                                          
|
 |                                                                          
|
 |                                                                          
|
 |   Data Description:                                                      
|
 |    generated by r.patch                                                  
|
 |                                                                          
|
 |                                                                          
|
 +----------------------------------------------------------------------------+
Thu, Apr 21 2005 14:57:35    Comments added by guest  
Cc: grass5@grass.itc.it

The other symptom of the bug is that with somewhat smaller raster (1202x1362)
in the same location (latlong,wgs84) r.to.vect manages to convert it to vector
points properly, but fails to create any dbf table - not informing the user
about it.

details:

GRASS 6.1.cvs (wgs84):~ > r.info srtm_odra_patched
 +----------------------------------------------------------------------------+
| Layer:    srtm_odra_patched              Date: Tue Apr 19 16:51:00 2005   
|
 | Mapset:   srtm_odra                      Login of Creator: trawiarz      
|
 | Location: wgs84                                                          
|
 | DataBase: /home/grassdata                                                
|
 | Title:     ( srtm_odra_patched )                                         
|
 |----------------------------------------------------------------------------|
|                                                                           
|
 |   Type of Map:  raster              Number of Categories: 494            
|
 |   Data Type:    CELL                                                     
|
 |   Rows:         1201                                                     
|
 |   Columns:      2401                                                     
|
 |   Total Cells:  2883601                                                  
|
 |        Projection: Latitude-Longitude (zone 0)                           
|
 |            N: 52:00:01.5N    S: 50:59:58.5N   Res: 0:00:03               
|
 |            E: 17:00:01.5E    W: 14:59:58.5E   Res: 0:00:03               
|
 |   Range of data:    min =  37 max = 494                                  
|
 |                                                                          
|
 |   Data Source:                                                           
|
 |                                                                          
|
 |                                                                          
|
 |                                                                          
|
 |   Data Description:                                                      
|
 |    generated by r.patch                                                  
|
 |                                                                          
|
 |                                                                          
|
 +----------------------------------------------------------------------------+
GRASS 6.1.cvs (wgs84):~ > g.region -p
projection: 3 (Latitude-Longitude)
zone:       0
datum:      wgs84
ellipsoid:  wgs84
north:      52:00:03N
south:      50:59:57N
west:       15:51:57E
east:       17:00:03E
nsres:      0:00:03
ewres:      0:00:03
rows:       1202
cols:       1362

GRASS 6.1.cvs (wgs84):~ > r.to.vect input=srtm_odra_patched
output=srtm_odra_patched_szerszy feature=point
 100%
Building topology ...
1635302 primitives registered
Building areas:  100%
0 areas built
0 isles built
Attaching islands:
Attaching centroids:  100%
Topology was built.
Number of nodes     :   1635302
Number of primitives:   1635302
Number of points    :   1635302
Number of lines     :   0
Number of boundaries:   0
Number of centroids :   0
Number of areas     :   0
Number of isles     :   0
GRASS 6.1.cvs (wgs84):~ > v.info srtm_odra_patched_szerszy
 +----------------------------------------------------------------------------+
| Layer:    srtm_odra_patched_szerszy      Organization:                    
|
 | Mapset:   srtm_odra                      Source Date:                    
|
 | Location: wgs84                          Name of creator:                
|
 | Database: /home/grassdata                                                
|
 | Title:                                                                   
|
 | Map Scale:  1:1                                                          
|
 | Map format: native                                                       
|
 |----------------------------------------------------------------------------|
|   Type of Map:  Vector (level: 2)                                         
|
 |                                                                          
|
 |   Number of points:       1635302         Number of areas:      0        
|
 |   Number of lines:        0               Number of islands:    0        
|
 |   Number of boundaries:   0               Number of faces:      0        
|
 |   Number of centroids:    0               Number of kernels:    0        
|
 |                                                                          
|
 |   Map is 3D:              0                                              
|
 |   Number of dblinks:      1                                              
|
 |                                                                          
|
 |   Projection: Latitude-Longitude (zone 0)                                
|
 |            N: 52.000        S: 51.000                                    
|
 |            E: 17.000         W: 15.866                                   
|
 |            B: 0.000         T: 0.000                                     
|
 |                                                                          
|
 |   Digitize threshold: 0.00000                                            
|
 |   Comments:                                                              
|
 |                                                                          
|
 +----------------------------------------------------------------------------+
but there is no atribute table as I said:

GRASS 6.1.cvs (wgs84):~ > d.vect srtm_odra_patched_szerszy
GRASS 6.1.cvs (wgs84):~ > d.what.vect -x
Building spatial index ...
 100%

Buttons
 Left:  what's here
 Right: quit

16:26:52.1875E(E) 51:23:59.4N(N)

srtm_odra_patched_szerszy in srtm_odra  Point
Layer: 1
category: 981194
driver: dbf
database: /home/grassdata/wgs84/srtm_odra/dbf/
table: srtm_odra_patched_szerszy
key column: cat
DBMI-DBF driver error:
Table 'srtm_odra_patched_szerszy' doesn't exist.
Error in db_open_select_cursor()

WARNING: Cannot open select cursor
Cannot open select cursor:<BR>'select * from srtm_odra_patched_szerszy where
cat = 981194'<BR>on database '/home/grassdata/wgs84/srtm_odra/dbf/' by driver
'dbf'<BR>
Done.

However a little smaller region of a raster (1202x1202) is always processed
properly into vector points - both the geometry and dbf table.

I'm using Mdk 10.1, Barton 3000, 1GB dual channel RAM, 512 MB swap, over 90 GB
of hdd space in my home dir and grassdata dir.

Maciek
Wed, May 11 2005 15:19:00    Comments added by msieczka  
Cc: grass5@grass.itc.it

Fri, Jul 7 2006 16:50:02    Mail sent by guest  
hi,

I think that we have this report twice:
http://intevation.de/rt/webrt?serial_num=3877&display=History

merge?

Markus
Wed, Jul 26 2006 14:36:43    User changed to tutey@o2.pl by msieczka  
Wed, Apr 25 2007 20:52:50    Status changed to resolved by msieczka  
Wed, Apr 25 2007 20:52:50    Mail sent by msieczka  
Markus wrote (Fri, Jul 7 2006 16:50:02):

> I think that we have this report twice:
> http://intevation.de/rt/webrt?serial_num=3877&display=History
> 
> merge?

Getting back to old stuff; good news here!

Not exactly the same. In this case there was enough RAM and SWAP to handle the
data; I didn't run out of the memory like in #3877. The problem was that
r.to.vect abnormally terminated, when it was almost done, with 'Broken pipe',
in spite of memory was still available.

As of now, I have just this re-tried the same setup with fresh 6.3 CVS and the
'Broken pipe' is gone! r.to.vect succesfully completes AND manages to create
the dbf table. Maybe there was some fix committed which I missed?

Summarising: currently, r.to.vect is able to tranform a raster created of 2 3"
SRTM tiles into vector points (2 883 600 of them!) and create a dbf table
using a little less than 1GB RAM + 1GB SWAP (merely!).

Isn't that great?

details:

$ g.region rast=srtm_odra_patched -ag
n=50.00041667
s=48.99958333
w=21.99958333
e=24.00041667
nsres=0.00083333
ewres=0.00083333
rows=1201
cols=2401
cells=2883601

$ r.to.vect input=srtm_odra_patched output=srtm_odra_patched_pkt feature=point
# Takes QUITE some time, but completes! One point less created than the number
# cells in region, cause one cell was null:

$ v.info -t srtm_odra_patched_pkt
nodes=2883600
points=2883600
lines=0
boundaries=0
centroids=0
areas=0
islands=0
faces=0
kernels=0
primitives=2883600
map3d=0

$ v.info -c srtm_odra_patched_pkt
Displaying column types/names for database connection of layer 1:
INTEGER|cat
INTEGER|value
CHARACTER|label

Closing ticket.

Maciek
Comment | Reply | Take | Open

You are currently authenticated as guest.
[Show Configuration] [Login as another user]

Users Guide - Mail Commands - Homepage of RequestTracker 1.0.7 - list any request