initialize model on 0
model type: cio
initialize model on 0
model type: cio
load from pretrain dir successfully
move model to gpu:0
start loading dataset on 0
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_0_cpcfg_train_raw_keepspan.ids
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_1_cpcfg_train_raw_keepspan.ids
Reducer buckets have been rebuilt in this iteration.
progress:10/40 loss: 3.856527805328369, parser loss: 0.3713613748550415
input sentence: ['the', 'agency', 'will', 'withdraw', 'from', 'the', '[MASK]', 'of', 'nine', 'food', 'products', 'maintaining', 'production', 'of', 'the', 'two', '[MASK]', '[MASK]', '[MASK]', '[MASK]', 'and', '[MASK]']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44544b9fd0>, '((the agency) (will (withdraw (from ((the production) (of ((nine (food products)) (maintaining (production (of (((the two) (most important)) (ones ((corn and) milk)))))))))))))']
progress:20/40 loss: 3.653022289276123, parser loss: 0.3234085142612457
input sentence: ['the', 'tenor', 'of', 'mr', '.', '[MASK]', "'", 's', 'remarks', 'seemed', 'to', '[MASK]', '[MASK]', 'british', 'air', 'will', 'take', 'a', 'more', 'active', 'high', '[MASK]', 'profile', 'role', 'in', 'pursuing', 'any', 'new', 'bid']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f4454e70a00>, "((the tenor) (of (((((mr .) stevens) (' s)) remarks) (seemed (to (indicate (that ((british air) (will (take ((((a (more active)) ((high -) profile)) role) (in (pursuing ((any new) bid))))))))))))))"]
progress:30/40 loss: 3.325742483139038, parser loss: 0.3794151544570923
input sentence: ['it', '[MASK]', '[MASK]', 'if', 'not', 'impossible', 'for', 'anyone', '[MASK]', 'has', 'not', 'por', '##ed', 'over', 'the', 'thousands', 'of', 'pages', 'of', 'court', 'pleading', '##s', 'and', 'transcript', '##s', 'to', 'have', 'a', 'dew', '##while', 'opinion', 'on', 'the', 'underlying', 'merits', 'of', 'the', 'controversy']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f4454eaff10>, '(it (is (difficult ((if (not impossible)) ((for anyone) (who (has ((not (por ##ed)) (over (((the (thousands of)) pages) (of (((court ((pleading ##s) and)) (transcript ##s)) (to (have (((a (worth ##while)) opinion) (on (((the underlying) merits) (of (the controversy)))))))))))))))))))']
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_2_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 3.338203191757202, parser loss: 0.26106977462768555
input sentence: ['at', 'that', 'price', 'an', 'analyst', '[MASK]', '[MASK]', 'the', '[MASK]', 'said', 'the', 'computer', 'offers', 'up', 'to', '[MASK]', '[MASK]', 'the', '[MASK]', 'of', 'similar', 'machines']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44541490a0>, '((at (that price)) ((an analyst) (familiar (with ((the machine) (said ((the computer) (offers ((up (to 10)) (times ((the performance) (of (similar machines)))))))))))))']
progress:20/40 loss: 3.1923305988311768, parser loss: 0.2853887975215912
input sentence: ['the', 'irs', 'already', '[MASK]', 'doing', 'intensive', 'tc', '[MASK]', '[MASK]', '[MASK]', 'of', '19', '[MASK]', '000', 'returns', 'for', 'ghent', 'and', 'fiscal', '1988', 'filed', 'by', '[MASK]', 'with', '34', '10', 'million', 'in', 'assets']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44542f6430>, '((the irs) (already (is (doing (intensive ((tc ##mp) ((audit ##s) (of (((19 ,) 000) (returns ((for 1987) (and ((fiscal 1988) (filed (by (corporations (with (((under 10) million) (in assets)))))))))))))))))))']
progress:30/40 loss: 3.0917415618896484, parser loss: 0.2865520417690277
input sentence: ['[MASK]', '301', '-', 'year', '[MASK]', 'old', 'exchange', 'is', 'battered', 'by', 'enormous', 'claims', 'from', 'a', 'decade', '-', '[MASK]', 'run', 'of', 'unprecedented', 'disasters', '[MASK]', 'most', '[MASK]', 'of', 'which', 'is', 'last', '##rco', "'", 's', 'earthquake', 'in', 'california', "'", 's', 'bay', 'area']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44468d5490>, "((the ((((301 -) year) (- old)) exchange)) (is (battered (by ((enormous claims) (from ((((a (decade (- long))) run) (of (unprecedented disasters))) ((the ((most recent) of)) (which (is ((((last week) (' s)) earthquake) (in ((california (' s)) (bay area))))))))))))))"]
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_3_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 3.1745638847351074, parser loss: 0.22315438091754913
input sentence: ['callum', 'mccarthy', '[MASK]', 'was', 'named', 'overgrown', 'the', 'new', 'post', 'of', 'deputy', 'head', 'of', 'the', 'corporate', '-', 'finance', 'division', '[MASK]', 'a', 'managing', 'director']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44467c1e50>, '((callum mccarthy) (45 (was (named (to (((the new) post) (of (deputy (head ((of ((the ((corporate -) finance)) division)) (and (a (managing director)))))))))))))']
progress:20/40 loss: 3.1769139766693115, parser loss: 0.2728499472141266
input sentence: ['mr', '.', 'ic', '##ah', '##n', 'has', 'long', 'believed', 'associates', '[MASK]', 'that', 'the', 'company', '[MASK]', '1988', 'sales', 'totaled', '16', '.', '88', 'billion', 'is', 'worth', '70', '[MASK]', '[MASK]', 'if', 'broken', 'up']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44541a9580>, '(((mr .) ((ic ##ah) ##n)) (has (long (believed (associates (say (that ((the company) ((whose 1988) (sales (totaled ((((16 .) 88) billion) (is (worth (((70 a) share) (if (broken up)))))))))))))))))']
progress:30/40 loss: 2.6789839267730713, parser loss: 0.30858197808265686
input sentence: ['wc', '##rs', '[MASK]', 'for', '[MASK]', 'part', 'will', 'now', 'be', '[MASK]', 'prefer', '##pse', 'its', 'long', '##standing', 'plan', 'of', 'becoming', 'a', 'holding', 'company', 'for', 'a', 'series', 'of', 'media', '-', '[MASK]', 'businesses', 'said', 'peter', '[MASK]', 'the', '[MASK]', "'", 's', 'chief', 'executive']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44544b4070>, "(((wc ##rs) group) ((for (its part)) (will ((now (be able)) (to (follow (((its (long ##standing)) plan) (of (becoming (((a holding) company) (for (((a series) (of (((media -) related) businesses))) (said ((peter scott) (((the firm) (' s)) (chief executive))))))))))))))))"]
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_4_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 2.7355408668518066, parser loss: 0.2453739196062088
input sentence: ['the', 'last', 'few', 'days', 'will', 'surely', 'slow', '[MASK]', '[MASK]', 'pace', 'of', 'events', 'says', 'scottish', '[MASK]', '##cable', '[MASK]', '[MASK]', 'mr', '.', 'gil', '##christ']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44544a0f40>, "(((the (last few)) days) (will (surely (slow (down ((the pace) ((of events) (says ((scottish (ami ##cable)) ((' s) ((mr .) (gil ##christ))))))))))))"]
progress:20/40 loss: 2.8145015239715576, parser loss: 0.2263571321964264
input sentence: ['sea', '##gram', 'asks', 'customers', '[MASK]', '[MASK]', 'only', 'two', 'or', 'three', '[MASK]', 'over', 'a', '12', '-', 'month', 'period', 'says', '[MASK]', 'shaw', 'vice', 'president', 'of', 'u', '.', 's', '[MASK]', 'direct', 'marketing']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44541575e0>, '((sea ##gram) (asks (customers (to (buy ((only (two (or three))) (bottles ((over ((a ((12 -) month)) period)) (says ((richard shaw) (vice (president (of ((u (. (s .))) (direct marketing)))))))))))))))']
progress:30/40 loss: 2.7373714447021484, parser loss: 0.2522633373737335
input sentence: ['china', 'had', 'refused', 'to', 'rep', '[MASK]', '##ria', '##te', 'citizens', '##sc', 'sneak', '##ed', 'annapolis', '[MASK]', 'kong', 'illegally', 'since', 'early', '[MASK]', 'month', 'when', 'the', 'colony', '[MASK]', 'a', 'di', '##ssi', '##dent', 'chinese', '[MASK]', 'to', 'flee', '[MASK]', 'the', 'u', '.', 's', '.']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44540faf40>, '(china (had (refused ((to (((rep ##at) ##ria) ##te)) (citizens (who ((sneak ##ed) ((into (hong kong)) (illegally ((since (early (this month))) (when ((the colony) (allowed ((a (((di ##ssi) ##dent) (chinese swimmer))) (to (flee (to (the (u ((. s) .))))))))))))))))))))']
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_5_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 3.1992995738983154, parser loss: 0.26465997099876404
input sentence: ['risks', 'motor', 'corp', '.', 'which', 'opened', '[MASK]', 'plant', 'in', 'georgetown', 'ky', '.', 'last', 'year', 'saw', 'sales', 'triple', 'to', '6', ',', '256', 'vehicles']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44467f9c70>, '(((toyota motor) (corp .)) (which (opened (((a plant) (in (georgetown (ky .)))) ((last year) (saw (sales (triple (to (((6 ,) 256) vehicles))))))))))']
progress:20/40 loss: 2.7735002040863037, parser loss: 0.25581565499305725
input sentence: ['but', 'mr', '.', 'rey', 'brought', 'about', 'a', 'merger', 'in', 'the', 'next', 'few', 'years', 'between', 'the', 'country', "'", 's', 'major', 'producers', 'the', '[MASK]', 'efficiency', '[MASK]', '[MASK]', '##ked', 'up', 'the', 'industry']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44469215e0>, "(but (((mr .) rey) (brought (about ((a merger) ((in (((the next) few) years)) ((between (((the country) (' s)) (major producers))) ((the (increased efficiency)) (has (((per ##ked) up) (the industry)))))))))))"]
progress:30/40 loss: 2.6816444396972656, parser loss: 0.23091819882392883
input sentence: ['additionally', 'cross', '##land', 'reported', 'a', 'third', '-', 'quarter', 'loss', 'of', '175', '[MASK]', 'arranger', 'million', 'or', '[MASK]', '.', '44', 'a', 'vida', 'compared', 'with', '[MASK]', 'income', 'of', '27', '.', '1', '[MASK]', 'or', '1', '.', '16', 'a', 'share', 'a', 'year', '[MASK]']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f444686e2b0>, '(additionally ((cross ##land) (reported (((a (third (- quarter))) loss) (of ((((175 (. 5)) million) (or ((13 (. 44)) (a share)))) (compared (with ((net income) (of (((27 (. 1)) million) (or ((((1 (. 16)) a) share) ((a year) ago))))))))))))))']
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_6_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 2.876581907272339, parser loss: 0.23304060101509094
input sentence: ['at', 'air', '[MASK]', 'meanwhile', 'the', 'mail', '##room', 'staff', 'opens', 'junk', 'mail', 'and', 'often', '[MASK]', 'it', 'away', 'even', 'if', 'addressed', 'to', 'an', 'individual']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44544afdf0>, '(at (air (products (meanwhile (((the (mail ##room)) staff) (opens ((junk mail) (and (often (throws (it (away (even (if (addressed (to (an individual)))))))))))))))))']
progress:20/40 loss: 2.503986358642578, parser loss: 0.25703391432762146
input sentence: ['observer', 'is', 'in', 'the', '[MASK]', 'of', 'reducing', 'its', '[MASK]', '-', 'bond', 'holdings', 'and', 'getting', 'out', 'of', 'the', 'investment', '[MASK]', 'business', '[MASK]', 'order', 'to', 'return', 'to', 'traditional', 'th', '##rift', 'activities']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44542c3610>, '(imperial (is (in ((the midst) (of (reducing ((its (((junk -) bond) holdings)) (and (getting (out ((of ((the (investment banking)) business)) ((in order) (to (return (to ((traditional (th ##rift)) activities))))))))))))))))']
progress:30/40 loss: 2.7000324726104736, parser loss: 0.24333088099956512
input sentence: ['predict', '##ably', 'some', 'navy', 'guys', 'said', 'do', 'we', 'still', 'need', 'to', 'keep', '[MASK]', '18', 'army', '[MASK]', 'on', 'active', 'duty', 'and', 'all', '[MASK]', 'extra', '[MASK]', '-', 'based', 'aircraft', '[MASK]', 'bases', 'and', 'all', 'those', 'army', '[MASK]', 'playing', 'admiral', 'in', 'tampa']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44542dc5b0>, '((predict ##ably) (((some (navy guys)) said) (do (we (still (need (to (keep (all ((18 (army divisions)) ((on (active duty)) (and (all (those (((extra (land (- based))) aircraft) (without (bases (and (all (((those army) guys) (playing (admiral (in tampa)))))))))))))))))))))))']
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_7_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 2.767163038253784, parser loss: 0.2336408495903015
input sentence: ['at', '11', '.', '1', '%', 'of', 'gross', 'national', 'product', 'clenched', '.', 's', '.', 'health', 'costs', 'already', 'are', 'the', 'kira', 'in', 'the', 'world']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f445437a640>, '((at ((((11 .) 1) %) (of ((gross national) product)))) (((u ((. s) .)) (health costs)) (already (are ((the highest) (in (the world)))))))']
progress:20/40 loss: 2.806349277496338, parser loss: 0.24551169574260712
input sentence: ['industry', '[MASK]', 'oil', 'production', '[MASK]', 'this', 'country', 'fell', 'by', '500', ',', '000', 'barrels', 'a', 'day', 'to', '7', '.', '7', 'million', 'barrels', '[MASK]', 'the', 'first', 'eight', 'months', 'of', 'this', 'year']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44544b0730>, '((((industry ##wide) (oil production)) (in (this country))) (fell (by ((((500 (, 000)) barrels) (a day)) (to (((((7 .) 7) million) barrels) (in (((the first) (eight months)) (of (this year))))))))))']
progress:30/40 loss: 2.5760133266448975, parser loss: 0.24994687736034393
input sentence: ['paper', 'and', 'forest', '-', 'products', 'stocks', 'declined', 'after', 'smith', 'barney', 'harris', 'up', '##ham', '&', 'co', '.', 'lowered', 'investment', 'ratings', 'on', 'inherited', 'number', 'of', 'issues', 'in', 'the', 'two', 'sectors', 'based', 'on', 'a', 'forecast', 'that', 'pulp', '[MASK]', 'will', 'fall', 'sharply']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f444683f460>, '(((paper (and ((forest -) products))) stocks) (declined (after (((((smith barney) harris) ((up ##ham) &)) (co .)) (lowered ((investment ratings) (on ((((a number) of) issues) ((in ((the two) sectors)) (based ((on (a forecast)) (that ((pulp prices) (will (fall sharply)))))))))))))))']
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_8_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 2.712623357772827, parser loss: 0.2167518138885498
input sentence: ['it', 'seems', 'to', 'me', 'the', 'bp', '##ca', 'plan', 'has', 'the', 'potential', '[MASK]', 'making', 'south', 'gardens', 'a', 'horticultural', 'jail', 'for', '[MASK]', 'and', 'plants']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44468b9040>, '((it seems) ((to me) (((the (bp ##ca)) plan) (has ((the potential) (of (making ((south gardens) ((a (horticultural jail)) (for (people (and plants))))))))))))']
progress:20/40 loss: 2.5884816646575928, parser loss: 0.2263478934764862
input sentence: ['col', '.', 'north', 'conveyed', '[MASK]', 'request', 'to', 'his', 'superiors', 'and', 'to', 'assistant', 'secretary', '[MASK]', 'state', 'elliot', '[MASK]', 'who', 'relay', '##ed', 'it', 'to', 'secretary', 'of', 'state', '[MASK]', 'shu', '[MASK]', '##z']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f4454095a90>, '(((col .) north) (conveyed ((the request) ((to (his superiors)) (and (to ((assistant (secretary (of state))) ((elliot abrams) (who (((relay ##ed) it) (to ((secretary (of state)) (george ((shu ##lt) ##z))))))))))))))']
progress:30/40 loss: 2.6166861057281494, parser loss: 0.25425848364830017
input sentence: ['[MASK]', '##yer', '##hae', '##user', "'", 's', 'pulp', 'and', 'paper', 'operations', 'were', 'up', 'for', 'the', 'nine', 'months', 'but', 'full', '-', 'year', 'performance', 'depends', 'on', 'the', 'balance', 'of', '[MASK]', '[MASK]', 'maintenance', 'costs', 'plus', 'pricing', 'of', 'certain', 'products', 'the', 'company', 'said']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44542d0550>, "(((((we ##yer) (##hae ##user)) (' s)) ((pulp (and paper)) operations)) (were (up ((for ((the nine) months)) (but ((((full -) year) performance) (depends (on ((the balance) (of ((((operating and) maintenance) costs) (plus (pricing (of (certain (products ((the company) said)))))))))))))))))"]
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_9_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 2.755338430404663, parser loss: 0.20605064928531647
input sentence: ['simon', '&', 'schuster', 'retains', 'the', 'corporation', 'law', 'loose', '##leaf', '[MASK]', 'which', 'will', 'become', 'part', 'of', 'its', 'prentice', 'hall', '[MASK]', '&', 'business', 'unit']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f4454f57e80>, '(((simon &) schuster) (retains (((the corporation) law) (((loose ##leaf) service) (which ((will become) (part (of (its (((prentice hall) (law (& business))) unit))))))))))']
progress:20/40 loss: 2.702895402908325, parser loss: 0.23121771216392517
input sentence: ['the', '57', 'memoirs', 'year', '[MASK]', 'old', 'mr', '.', '[MASK]', '##ess', '[MASK]', 'who', 'was', 'also', '[MASK]', 'chairman', 'and', 'chief', '[MASK]', 'of', 'all', '[MASK]', '##a', '[MASK]', 'succeeds', 'john', 'a', '.', 'freaked']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44468a9520>, '((the ((((57 -) year) -) old)) (((mr .) ((gr ##ess) ##ette)) (who ((was (also elected)) ((chairman (and ((chief executive) (of (all ((scan ##a) subsidiaries)))))) (succeeds (john ((a .) warren))))))))']
progress:30/40 loss: 2.5513558387756348, parser loss: 0.2221137136220932
input sentence: ['let', 'us', 'look', 'for', '[MASK]', 'moment', 'at', 'another', 'type', 'of', 'whichever', '-', 'violent', 'civil', 'di', '##so', '##bed', '##ience', 'that', 'only', 'harm', '##s', 'other', 'people', 'indirectly', 'yet', 'does', 'ir', '[MASK]', '##para', '[MASK]', 'damage', 'to', 'the', 'nation', 'as', '[MASK]', 'whole']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44541972b0>, '(let (us (look ((for (a moment)) (at ((another (type (of ((((non -) violent) civil) ((di (##so ##bed)) ##ience))))) (that ((only (harm ##s)) ((other people) ((indirectly yet) (does (((ir (##re ##para)) ##ble) (damage ((to (the nation)) ((as a) whole)))))))))))))))']
Loading shuffled samples from /input/wsjkeepspan_batch_512_maxlen_3072_ascending/cached_shuffle_10_cpcfg_train_raw_keepspan.ids
progress:10/40 loss: 2.7397029399871826, parser loss: 0.20341581106185913
input sentence: ['you', 'ca', 'n', "'", 't', 'ask', 'one', 'carrier', 'to', 'under', '[MASK]', '[MASK]', 'social', 'grounds', '[MASK]', 'that', 'might', 'destroy', 'it', 'in', 'the', 'marketplace']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44542240a0>, "(you ((ca ((n ') t)) (ask ((one carrier) (to ((under ##write) (((on social) grounds) (when (that (might (destroy (it (in (the marketplace))))))))))))))"]
progress:20/40 loss: 2.5234696865081787, parser loss: 0.23198163509368896
input sentence: ['[MASK]', '##w', "'", 's', 'pitch', '[MASK]', 'that', 'sales', 'and', 'earnings', 'at', 'its', '[MASK]', 'have', 'risen', '[MASK]', 'and', 'that', '[MASK]', '[MASK]', 'n', "'", 't', 'stop', 'eating', 'during', 'a', 'down', '##turn']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f44467e7520>, "((((t ##w) (' s)) pitch) (was (that ((((sales and) earnings) (at (its restaurants))) (have (risen (steadily (and (that (people ((wo ((n ') t)) (stop (eating (during (a (down ##turn))))))))))))))))"]
progress:30/40 loss: 2.427391529083252, parser loss: 0.23462031781673431
input sentence: ['we', 'need', 'a', '[MASK]', 'os', '##tp', '##oli', '##ti', '##k', 'says', '[MASK]', 'rope', '##r', '[MASK]', 'the', 'royal', 'institute', '[MASK]', '[MASK]', 'affairs', 'in', 'london', 'referring', 'to', '[MASK]', 'germany', '[MASK]', 's', '[MASK]', '##standing', 'policy', 'of', 'a', 'diplomatic', 'opening', 'to', 'the', 'east']
parsed tree : [<data_structure.r2d2_tree.PyNode object at 0x7f445459c2e0>, "(we (need (a (western (((((os ##tp) ##oli) ##ti) ##k) (says ((john (rope ##r)) (of (((the (royal (institute ((of international) affairs)))) (in london)) (referring (to ((((west germany) (' s)) ((long ##standing) policy)) (of (((a diplomatic) opening) ((to the) east)))))))))))))))"]
